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Prefaca 



Researchers in vocational education have recently expressed a concern 
for the needfto innprove the foous. conduct, and innpact of research 
activities related to the delivery of vocational education. 

In order to-^ffect this area of concern, more^.bout the state of the art 
of researclywithin the realm of priority activities must be known. Exam- 
ples of quality research need to pe identified and held up" to the 
communit^of researchers and potential researchers. This, it is thought, 
Will proVi^ a base for the further judgment of research and for the 
identificaWon of'voids in current research as well as the design of future 
research These are the broad goals of this first volume of Ihe Annual 
Review c/ Research in Vocational Educatibn. 

To ac5omplish these, goals, a plan requinng four steps with the in- 
volvement of many people was implemented. These steps were. 1) the 
identifKjiation and selection of topic or priority area^2) the identifica- 
tton. selection, and invitation of section editors, 3) the review of re- 
search'^'and selection of lighthouse studies by section editors, and 
4) the^Compilation and publication of the volume. 

Through an^analysi^of legislation and current research activity, five 
areaspA/ere identified as priorities for program improvement. Sex-Role 
Stere^ftyping and Sex Equity, Curriculum and Instruction, Special Popu- 
latiorfs. Career Development, and Employment and Training. Section 
edito/s were then identified and invited based on their expertise in 
one^f these five areas, as exemplified by research experience in the 
confent area, experience in editorial work*and recognition as a national 
leader in research on vocational education. The responsibilities of the 
section editors included reviewing extant literature on the topic, ider>- 
tifyit\g lighthouse studies which are current (1975-present), exemplar^, 
and^.fA/hich vary on focus, purpose, methocf'and findings, syrithesizing 
the^^^xample studies^on method, topic and findings, and offering sug- 
gestions for future needed research. 

TK^ five sections included in this first volume of the Annual Review 
of RBsearch in Vocational Education not only represent a sampling 
of cjirrent research priorities in our field but also provide us with direc- 
tion.'^or future research The sections are briefly described m the follow- 
ing paragraphs. 

Research efforts related to sex equity in vocational education are 
summarized by M Eloise Murray m Section One. A distinction is first 
madbbetween those studies specifically related to the goal of sex equity 
and those (termed "Sex Affirmative") which focus on maximizing op- 
portunities for certain groups of people (usually female). Studies of 
this l^ter type have been included with sex equity studies, since Murray 
feels that their results and/or procedures may be used in efforts related 
to the goal of sex equity. The Kutner and Brogan conceptual model 
discussed in Nancy Kutner's Sources of Sex Discrimination in Educa- 
tional Systems Implications for Vocational Education" is used as the 
framework for the classification of research studies in this ^section. 
Throughout Jhe exemplary studies, faculty and students (as well as 
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educational materials) are cited by researchers as sources of sexual 
inequity in vocational education. Kerry Moyer's study, "Tlie Student 
as a Source of Sex Inequity in Vocational Education" addresses the 
topic of student attributes which directly influence career choice and 
notes the effect of parents upon that choice. Jennette Dittman cites the \ 
influence of educators' sex-role perceptions (including counselors, 
teachers, ^nd administrators) upon the career decisions of students 
In their study, Reverse Sex-Stereotyping Case in Point. Court Report- 
ing, Marcia Anderson and Beverly Stitt examine the cause^'of the 
exclusion of men from a formerly male-dominated profession Murray 
concludes that the "findings from the effort to-date plus the findings 
of related studies suggest further research is warranted." 

Section Two describes past trends and predicts future trends in voca- 
tional education curriculum and instructional research. Curtis Finch 
summarizes research of th6 1960's and early 1970's as being :'overly 
simplistic and problematic 4n natyre,'* while recent research has tended 
to be more specific and comprehensive. Included in his review are 
exemplary studies which focus on specific needs in the areas of cur- 
riculum and instruction. Sharon Lund O'Neil and Robert Nelson identify 
those occupational survival skills'* which are essential to job mainte- 
nance. Influence of Reading Ability and Verbal Modality on Principle 
Learning of Vocational Students" by Bob Stewart, Neil Lash, and H C 
Kazanas emphasizes a need to meet the learning needs of individual 
students. Dorothy Kizer and M. Marguerite Scruggs examine the tie ' 
between student achievement and the behavior of teachers ''Personal 
Characteristics as a Means for Identifying Adoption-Proneness Among 
Vocational Teachers" by David Oscdrson focuses on how innovations 
in education are adopted or rejected. Finch suggests that "our fgture 
will be greatly influenced by the extent to which systematic, program- 
matic research activities are carried out." 

In Section Three, research "operationally defined to encompass a 
number of activities that have as a common goal the improvement of 
vocational programs for special needs populations'^ is reviewed by 
L. Allen Phelps. Four major special populations are addressed in his 
review of research, limited English speaking, handicapped, incarcer- 
ated and disadvantaged learners. While there have been many recent 
legislative mandates for vocational and career education programming ^ 
for special need groups. Phelps comments that the rate of development ^ 
and expansion of programs has been restricted due to ''fragmented 
and limited research, development, and dissemination efforts." 

Four lighthouse studies are presented. The Olympus Research Cor- 
poration conducted two studies by John Walsh in 19744pd by John 
Walsh and Jan Totten in 1976 which focus on the "policies, programs, 
and services at the state, local and project level" for the handicapped 
and disadvantaged. The Iowa Vocational Education/Special Needs 
Assessment Study by Charles Greenwood and Raymond Morley exam- 
ines the extent of services provided to disadvantaged and handicapped 
Students by means of 1,265 mail survey responses from state and sec- 
ondary level vocational education instructors. The Soljneck. Lerwick, 
and Copa study of vocational-technical education programs in Minne- 



sola was commissioned to determine future program needs for ser- 
vices to handicapped or disadvantaged students. 

Phelps concludes that these and other studies suggest a large 
array of pontinuing issues and problems requiring res^Ach." 

Rfichard W Feller and David V. Tiedeman examine research related 
to career development theory with regard to its substantive and pro- 
cedural dimensions m Section Four. They first outline the deep struc- 
ture" of career development theory as it has developed during the past 
30 years. The co-editors then summarize examples of current research 
which exhibit a "continuing search for a comprehensiye and more 
general model" in career developme^nt theory as well as an expanding 
interest in areas such as. career development of women, special needs 
groups, minorities and youth, effects of sex bias and stereotyping, 
career indecision and mid-career change. Feller and Tiedeman make 
a distinction between "decision" and "choice" as a "foundational 
paradigm for theory in career development" with the' intention that 
the basis for theory be grounded in "personal comprehension of career 
^s a construction perfected through life" rather than in occupational 
choice. 

The National Assessment of Educational Progress (NAEP) was used 
to survey the educational achievements of four milestone" age groups 
(nine, thirteen, seventeen and adult). This assessment is describe?] 
in "Overview" by Tiedeman, Katz. Miller-Tiedeman and Osipow. The 
relative effectiveness of the Flanagan, Holland and Roe occupational 
classification systems is studied in the McLaughlin and Tiedeman study 
"Eleven- Year Career Stability and Change as Reflected m Project TALENT 
Data Through the Flanagan, Holland, and Roe Occupational Classifi- 
cation Systems." John D. Krumboltz with Anita M. Mitchell and G. Brian'' 
Jones examines the choice of career through a social learning theory 
analysis. The causal relationships among "career progress, sex-role 
attitudes, and cognitive styles" is examined by Kass, Moreland, Harren 
and Tinsley in Causal Inference Among Variables Related to Career 
Decision Making. The Chicken Or the Egg" Feller and Tiedeman be- 
lieve the recent challenges of career development theory will help to 
re-establish the basic "deep structure" of career development' theory. 

In Section Five. Robert McGough and Daniel Vogler provide a review 
of recent research sponsored by the Departnrient of Labor m the area 
of employment and training. The co-editors believe that vocational 
education researchers have compatible priorities with the Department 
of Labor, aQd,may therefore have research funds made available to. 
them. They have selected five articles which are representative of func- 
tional areas of policy, forecast, evaluation, demonstration, follow-up 
and experimental" activities in employment and training (E & T) 
research. 

"A Description of (he National Longitudinal Surveys" is provided by 
Herbert S. Parnes and Kezia Sproat. These studies, which focus upon 
certain characteristics of the same group of people over two or more 
points in time, were contracted to examine the labor market experi- 
ence of men (age 45-59), women (age 30-44), young men and women 



(age 14-24), and youth (14-21) in the United States Arnold Katz de- 
scribes the aims and objectives of the Federal-State Employnnent Ser- 
vice (ES). The study, Documentation and Evaluation of CETA-Educa- 
.tion Linkage Efforts and Activities in the Commonwealth of Virginia" 
by Max S Wortman, Jr., Suzanne Karsa Murrman and Nathaniel Jones 
exarnipes examples of coordinative efforts of prime sponsors and edu- 
cators. Russell Rumberger examines the economic fJosition of college 
graduates between 1969 and 1975 in his article, The Economic Decline 
of College Graduates — Fact or fallacy'^" Finally, Bruce McKinlay 
and Michael R. McKeever describe the Career Information System (CIS), 
a computerized occupational and educational information delivery 
system. 

McGough and Vogler conclude. "The unrque opportunities offered^ 
by E & T research involvement will seVve to complement the research 
activities of vocational education with the result being the enhance- 
ment of vocational education programs." 

In addition to meeting its intended goals, it is hoped that the ARRIVE 
will be used in imaginative ways. The following represent suggested 
uses or potential outcomes 

1 Review of the section titles should provide the novice with an indi- 
cation of five perceived priorities for Research and Development in 
Vocational Education, 

2. The Research Review" segments of each section provide an out- 
standing base for developing a general understanding of the scope 
and type of research within a priority area, 

3. The lighthouse studies can provide the researcher and potential 
researcher with ideas regarding topic selection, design apd reporti ng, 

4. The presentation of selected studies can serve to ffeinforce excep- 
tional work and say "well done," and 

5. The total volume can provide input to the identification of needed 
research for use by individual researchers as well as by personnel 
in* agencies responsible for funding research and development 
activities. 

This volume represents the efforts of many individuals playing many 
different roles. The General Review Board members, the section edi- 
tors and the contributing authors are all due an extension of gratitude 
Additionally, the utmost thanks are due to Deborah K. Nelson for her 
expert assistance in handling the technical e^jiting and administrative 
detaiTs of this volume. 

June 1980 Tim L. Wentling, Editor 
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SECTION ONE 



Research on Sex Equity ^ 
in Vocational Education 



M. ELOISE MURRAY 
ThejPennsylvania State Universi-ty 



' Research Review 

INTRODUCTiqN 

The purpose of this section is to summarize research effort related to 
sex equity in vocational education. One of the perplexing tasks associ- 
ated with this responsibility was the decision-making necessary to 
determine whfeh studies were specifically focused on the goal of sex 
equity and which were efforts directed toward maximizing opportuni- 
ties for a specific group, usually females, The latter behavior has been 
Identified as sex affirmativeness by the Resource Center, on Sex Roles 
in Education (1977). While consideration of developing nontradjtional 
vogational options for women may have been a beginning focus and 
remains a nec^sary and critical concern, it is not a sufficient defini- 
tion of the challenge to develop sex fair vocational education programs 
Several of the studies included in thi's review are sex affirmative in 
^ nature, however, their procedures and/or findings off^r examples for 
persons concerned with sex equity. ' . 

jhfee additional comments about this review bear^entibning First, 
the concern for sex equity in education was not initiated" in vocational 
education. Indeed there appears to be evidence in some sectors that 
vocatio'nal educators are reluctant entrants to this arena. Those voca- 
tional eclticatc(fswho are interested in sex equity as an area of research 
are advised to examine practiced and progress of those working in 
other educational settings. Second, the literature examining sex equity 
in vocational education is largely fugitive. The system of funding of 
projects has resulted in reports that often do not receive large dissemi- 
nation. In addition to standard library procec^ures, each state equity 
coordinator and research unit coordinator was contacted to^-Qbtain 
relevant reports, however, a less than 35 percept return rate probably 
indicates there are other studies awaiting discovery. Third, the nature 
of the project system in vocational education, with the concomitant 
requirement of usefulness to the field means that much of the rese^h 
• IS of an applied nature. This observation is made as a statement offact. 
\ not as an evaluative comment. 



The .framework, used in this review for classifying the research studies ^ 
m the are^ of sex equity is the Kutner and Brogan conceptual model 
(1976),' a<liscussion of which is the lead article in this section. This 
model virews sex equity or inequity as an intervening variable m the 
relationship of a large number of independent variables and the result- 
ing dependent variable^of achievement in education and consequently 
in occupation. The researchers cited may not have construed their 
studies in this manner and indeed some studies lie outside the variables 
Identified by the model, however, it provides a system of ^alysis which 
is heuristic. 
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' Internal Structures of Individuals ^ . ' ^ 

Two groups of subjects, faculty an^ students, have^been the principal 
targets of those researchers examining the sex equity through 
the anaylsis of the psychological-cognitive structure (see FWjre'2 of 
Kutner article) These variables include occupational aspirathan and 
expectation, self concept, sex role orientation and the effect ot the 
socialization process. V/ 
Using data from a state-wide assessment program, Moyer synthe- 
sized two previous repbrts by Moyer (1978) and Moyer and Skiffmgton 
(1978) as the second featured study in this section. These data suggest 
students themselves are a, source df inequity in vocational program 

, enrollments Thijs conclusion is supported by Gulledge (1978), McEwen, 
Brock, Moseley, Muncey, Rich, Davis, and Porter (1978) and Ott (1978) 

• from somewhat more limited studies. McEwen et al. noted: 

Culturally supported sex stereotypes of occupations are quickly learned by 
young people and act to channel and limit their aspirations for jobs and ca- 
reers These are often reinforced — and occasionally challenged — by the 
expectations of educators, peers agd parents and by the role models evident 
in the mass media and in the life experience of young people. (1978, p 1) 
Mitchell (1977) concluded after her study of attitudes toward vocational 
eqlucation that, adolescent females are still likely to choose a tradi- 
tionally female identified program even while they believe they could 
enter a previously male intensive program. However, there is evidence 
that school persopnel do seek to irWIuence choices. With particular 
regard, to the handicapped student, Danker-Brown, Sigelman and Flexer 
(1978) found that while males aQd females did not differ in the amount 
of vocational training, "qualitative differences in training were consis- 

' tent with sex role sterebtypes, and females were more likely to have 
beeh exposed to sheltered forms of employment." (p. 45) 

Lewis. Kaltreider, Murray, Lewis, and Flanary (1976), Mitchell (1977) 
and Ott (1978) included in their studies the impact of others such as 
parents and school faculties upon the adolescent's choice ot program. 
In general the research examining these interactive relationships sug- 
gests ^fprts to develop sex equity in vocational education\peed to be 
directed toward all sectors of the school structure including parents 
and the^rk place. The work of Bucher (1974) and Guiry (1978) sug- 
gests that change of efforts with students should begin early in'their 
school years and be reinforced as they proceed toward vocational 
choice. 

"Tne factors affecting adolescent students do not necessarily apply 
to the postsecondary vocational education participant. Chitayat and 
Hymer (1976) document a process used to recruit mature female stu- 
■ dents Kane, Frazee, and Dee (1976) explored in detail those factors 
affecting the mature female student's selection of a non-traditional 
vocational education program. 

Perhaps even more than general education, vocational education 
extends beyond the school into the community because of the need 
to place students in work role&, either on a part-time or cooperative 
education basis or as full participants in the labor force. The findings 




Barenbaum (^977\ suggest employers practice sex discrimination 
and sex stereotyping jri hiring personnel, even when they are able to 
identify the mostqualified job applicant. 

The third example.study in this section based* on Dittman (1976) is 
representativG-of those which select faculty as the population for exam- 
ining the sex equity ii^ue. Unlike the early.$ind important work of Steele 
(1974) and the report"* of the Sex Equity Unit of South Carolina (1978), 
these studies ao hot seek to only indicate ^ex ratiosjn faculty and stu- 
dent populations buf also^to xJocum^nt the faculty members' percep- 
tions of appropriate sex role orientation on the assumption that such 
perceptions influence behavior toward students. Dittman (1976), Ever- 
sole (1977) and Hantjis (1977) indicate that vocational educators hold 
sex stereotyped views. This finding is not monolithic, for educators in 
, various program areas differ in the degree to which they hold such 
views. In summary, females have less stereotypic vifews than males, 
home economics, health occupations and^offic'e occupations person- 
nel are more liberal arad more knowledgeable than agricultural and 
trade and industries personnel, those person^ who have less stereo- 
typic views have greater intent of changing their behavior Using Idnho 
vocational educators, administrators and counselors as the popula- 
tions, Kaufman, 'b^ks a/id Rauch (1978) concluded that vocational 
educators feel more dissatisfaction with student sex ratios per pro- 
gram than with teacher proportions. However, while enrollment dis- 
panttes were considered by vocational educators to be neither satis- 
facta(v nor ideal/ihey were perceived to be practical and satisfactory 
to theS^munny. The work of Dennison (1978) using a population of 
vocationM^ackfiinistrators supports these general conclusions 

The complex nature of the relationship between vocational educa- 
tion personnel and sex eqCiity in vocational program^s is well docu-^ 
' mented by Atkinson (1978) in the following summary: 

Among a majority of respondents, the sources of sex-role stereotyping are 
perceived to exist outside as well as within the educational system 

However, four factors suggest that for a majority of the respondents sam- 
pled, sex-role stereotyping and bias in the schools is not perceived to be a 
major cause of limited vocational opportunity at the secondary level First, 
only a few respondents linked sex-role stereotyping with limited vocational 
opportunity. Second, most respondents did not identify barriers in the school 
'system with expanding vocational options. Third, sex-role stereotyping is^ 
perceived by many educators to impact insignificantly to people's lives 
Fourth, the lack of high priority status which respondents assigned to elimi- 
nating sex-role stereotyping is consistent with their limited perceptions pf 
s the Issue of sex-role stereotyping in vocational education. 

Perhaps these points of view may be attributed to the phenomenon *of^ 
few students entering vocational programs in which they have not tradition 
ally. participated, (p. 11) , . 

And further, among educators, articulation of the j«^e of sex-role stereo 
typing and its manifestations in vocational education depends upon an under 
standing^ of how socialization through sex and gender effects occupational 
choice and preparation. Only through awareness of the Issue of sex-role 
stereotyping in vocational education will educators be equipped to recognize 
common problems. A needs assessment among secondary schools (in fVlichi- 
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gan)* should not be undertaken without the skills to identify how, when, and 
where sex-role stereotyping can be manifested in vocational education 
setting, (p 12) * 

Relative to needs assessment, Sorg (1978) has developed and field 
tested a nnodel, for use by vocationali educators, which will assess the 
extent to which sex bias^and sex stereotyping exist in programs. Fur- 
ther development including refining of measures is currently in prog- 
ress (Sorg, 1979). 

The role of counselors and their views related to the issue of sex 
equity with regard to vocational student's choice of program was not 
included as a separate entity in this review. Many of the studies cited 
did investigate these variables. In addition, there is a large and growing 
body of literature originating from personnel and guidance investi- 
gators attempting to identify and overcome what h^s been a generally 
negative situation. Vocational educators would be advised to review 
this literature for both findings and procedures. 

Neely, Wilson, Schuley, and Keggi1978) provide extensive documen- 
tation on the sex bias barriers perceived to exist fd^^women aspiring 
to vocational administration posts. This mtenm report will benefit from 
further elaboration and explanation of the ^dings. 

Fdrmal Structures of Educational Systems 

One aspect of the formal structure of school s^^tema identified by 
Kutner and Brogan (1976) as a potential source of sex bias and stereo- 
typing IS educational materials. Bannon (1975), R^y and Dohner(1978) 
and Weis (1979) all conclude that in the area of home economics, 
materials exhibit less than equitable treatment of males and females. 
Weis (1979) summarizes as follows: i» 
Although 'home economics textbooks generally imply an orientation to a 
gender neutral student clientele or explicitly orient their prefaces to both 
sexes, the contents of these educational materials presented sex bias in lan- 
guage usage, pictures portraying male and female role requK-ements. and m 
role behaviors and expectations emphasized, (p. 158) 

Similar findings are reported by Lovell (^977) in the area of career enju- 
cation. No related studies examining materials in other areas of voca- 
tional education were located. — 

The role that recruitment materials and procedures may play in the 
sex ratio of student enrollment was examined by Anderson and Stitt 
(1978). A summary of this research appears as the fourth example 
study in this section. 

Efforts Directed toward Change 

The projects which attempted to change the attitudes, and behaviors 
of personnel in vocational education, including students, teachers, 
counselors and administrators, were the largest single category re- 
lated to the issue of sex equity, yet, in fact, most are best described as 
sex affirmative effort. As projects they vary rhnmensely m their com- 
pleteness. Some develop materials and/or approaches and provide 
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no data o/use, Ellis (1977), Murray (1978); some provide purely de- 
scripthve data. Lerner, Bergstrom, Champagne {^976), Smith t1977), 
Caughman (J 978), Ferris (1^77, 1978). In spite of design deficiencies, 
each of these efforts does make a contribution to future studies. 

Those studies which provide pre/post data are somewhat inconclu- 
sive in supporting the hypothesis thiat short term effort can change 
vocational educators' altitudes and perception with^regard to sex 
equity. That the literature related to altitude change in general and to 
factors associated with compliance with regulations indicate such 
mconclusiveness is not surprising. Working with home economics 
teachers (femalfi)^-afKl vocational counselors (male) with a five hour 
workshop as freatmem. Griffin (1978) obained statistically significant 
differences (p = .001) on an instrument developed for the study called 
Sexism Awareness Instrument. The teachers consistently scored 
higher than counselors on this instrument (p = .001) for both pre- and 
post-test scores. This finding is very much in keeping with those studies 
cited above which noted that females are generally more aware of sex- 
ism and rnore open to change. Walters (1976) used a similar approach 
to determine if vocational education personnel would change their 
attitudes toward women's role in education and the labor force.* The 
findings were that while administrators changed on pre- and post-test 
scores on the Rokeach Dogmatism Scale (p = .025), they did not change 
significantly on a measure titled Attitudes Toward Women Scale. 
"vWorking with mature females who are potential vocational education 
program participants and using a three week workshop as treatment, 
Willis and Hopson (1979) concluded that the participants' attitudes 
toward availability of non-traditional jobs (to them) had changed sig- 
nificantly. Further, it was the attitudes of the men in their lives which 
hindered pursuit of non-traditional employment. This latter finding 
supports the notion that change in vocational edjjcation involves effort 
with persons beyond the aaual school. ^ 

SUMMARY 

The available studies concerning the issue of sex equity in vocational 
education investigate a large number of the independent variables 
suggested by Kutner and Brogan (1976). The model suggests other 
areas of study. Many studies go beyond this model and offer promising 
leads. 

Based on the studies reviewed, one can say that sex bias and sex 
stereotyping exist in the attitudes and behaviors of participants in 
vocational education. These participants include students at both 
secondary and post-secondary levels, members of students' families, 
teachers, administrators and those who hire the products qf vocational 
education programs. The materials used in vocational programs also 
exhibit a lack of sex equity. Efforts at changing the situation meet 
with varying degrees of success. 

The following pages of this section include the reports of the model 
and research prepared by Nancy G. Kutner, Kerry Moyer, Jennette Ditt- 
man, Marcia A. Anderson and Beverly A. Stitt and a comment or syn- 
*thesis on their works by the section editor. 
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Sources of Sex Discrimination in Educational Sysjems:\ 
Implications for Vocational Education ^>< 



NANCY G.'KUTNER 
Emory University*. 

In this paper,- a framewonk for a 
general conceptual model inter- 
relating sources of sex discrimina- 
tion m educational systems (Kutner 
& Brogan, 1976) is reviewed Sex dif- 
ferences in mathematics training 
and careers are discussed -as an 
illustrative case, and implications of 
the model for vocational education 
are outlined 

ASSUMPTIONS OF THE MODEL 

Although'^oth males and females 
are victims of sex discrimination m 
educational systems, it is assumed that 
females are victims [o a greater ex- 
tent than are males Alexander and 
Eckland (1974). who examined the 
effects of sex. status background, 
and academic ability in an elaborated 
school process model, found that 
"the most significant feature 
was the direct, unmediated depressant 
sex effect on actual educational at- 
tainment." This effect remained "de- 
spite simultaneous controls on a 
large number of variables pertinent 
to educational attainments academic 
ability, status background, perfor- 
mance, educational goal orientations, 
academic self-concept, curriculum 
enrollment, and the influence of 
various significant others (parents, 
teacher, and peers) " (p 680) 

A second assumption of the 
general model is that women may be 
viewed conceptually as a "minority 
group" (Hacker, 1951) General theo- 
retical perspectives on majority- 
minority relations such as those dis- 
cussed by Blalock (1967) can then 
be applied to discrimination ex- 
perienced by women in our society. 
%Followjng Blalock (1967), "certain 
independent variables lead to dis- 



crimination, which in turn produces 
inequalities " (p 18) Thus, the 
concept of discrimination (in this 
case, sex discrimination m education)^ 
can be viewed as a yanable intervening 
111 a causal sequence which links 
vinous independent variables and 
the dependent variable of inequality 
(in thts case, sex inequalities in 
educational achievement). A model 
of discrimination and resulting sex 
inequalities in educational achieve- 
ment IS outlined in Figure 1. 

The general model presented m 
Figure 1 \s believed applicable to all 
levels of the educational system. At 
the time that formal vocational educa- 
tion IS introduced, typically during 
the early adolescent years, important 
aspects of young people's psycho- 
logical-cognitive outlook, which^ in 
turn mfluence their occupational 
' oYientations, have already been 
shaped. 

COMPONENTS OF THE MODEL 

The Dependent Variable: Sex 
Inequalities in Educational 
Achievement 

Important manifestations of sex 
inequalities in educational achieve- 
ment mclude sex differenced in aca- 
demic achievement (e.g., lower average 
scores for females on the quantitative 
section of college entrance examma- 
tions), lower enrollment of women 
as compared to men in graduate, 
professional, and post-secondary 
technical schools, and the lower 
number of women as compared to 
men who obtain graduate and pro- 
fessional degrees. 

Academic achievement. At thd^ele- 
mentary school level, there i^ little 
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FIGURE 1 

ConceptiiakA/lodel oi Processes Contributing to Sex Discrimination 
in Amencan,Education (Kutner and Brogan, 1976) 
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difference between males' and fe- 
males measured academic achieve- 
ment in mathematics and science. 
Hilton and Bergfund (1974) used a 
longitudinal design to study mathe- 
matics achie\iement and in|terests 
over a seven year period with, a large 
sample of sffidents, beginning at the 
fifth grade level. Although girls and 
boys were equivalent m mathematics 
achievement in the fifth grade, sig- 
nificant differences by sex in interest 
m math and science began emerging 
at grade nine, with differences wid- 
ening at the eleventh grade level In 
addition, males had successiveFy 
higher mean math achievement 
scores than did females at subse- 
quent grade levels afflir grade five 

Females are significantly less likely 
than males to take four years of high 
school mathematics (Sells, 1973. Erv 
nest, 1976) This fact has important 
implications for females' higher edu- 
cation at a school such as Berkeley 
The 4 year math sequence is re- 
quired for admission to Mathematics 
1A, which m turn is required for ma- 
joring in every field at the University 
except the traditionally female, and 
hence lower paying, fields " (Er- 
nest, 1976, p. 9). 

At the college level, women tend 
to get better grades than do men in 
all fields. E/nest (1976) found no sig-' 
nificant differences in the grades 
achieved by women and men in the 
elementary calculus sequence How- 
ever, as noted ^bove. women are less 
likely than men to take mathematics 
courses m college. 

In graduate and professional 
schools, there is little difference 
between the measured academic 
achievement of men and women 
For example, women perform as 
well as, or better than, men in medi- 
^ cal school (Lopate, 1968, Weinberg 
& Rooney. 1973) But it should be 
noted that these are women who 
have been carefully selected for 
medical school and often have 
higher academic qualifications than 
men who are admitted (Feldman. 
1974. Kutner & Brogan, 1977). 



The conclusion which emerges is 
that women are equally capable of 
achieving academically at levels 
characteristic of their male peers 
The nature of women's achievement 
tends* to differ, however, in that 
women are less likely than men to 
pursue the mathematics and science 
courses which would prepare them 
for careers in mathematics-related 
fields such as statistics or opera- 
tipn^research, or for careers in med- 
icine, engineering, and other scier^ 
tific fields. 

Enrollment m graduate, professional, 
and post-secondary technical schools 
Although the enrollment of males and 
females in educational mstitutions-is 
about equal through elemer^tary, sec- 
ondary, and undergraduate school, 
fewer women than men are enrolled 
as graduate students In addition, in 
post-secondary technic aTschools, 
graduate schools, and professional 
schools, there are a number of fields 
which have an underrepresentation 
of women or men. For example, 
worn^p are underrepresented in tech- 
nij^atTschool areas swch as auto me- 
cnaf^cs, carpentry, and bricklaying, 
while men are underrepresented in 
areas such as secretarial training. 
Although more men now enter fields 
such as nursing and elementary edu- 
cation, and more women now enter 
fields such as medicine, dentistry, 
and law than has been true in the 
past, the former fields are still fe- 
male-intensive while the latter fields 
remain male-mtensive. And, as Pitts 
(1978) points out, a much publicized 
increase in the numbers of women 
admitted to medical school may ac- 
tually rpask the much slower increase 
in the percenfape of women m medi- 
cine. 

Level of educational attainment. Al- 
though a slightly larger percentage 
of females than males graduate from 
high school, more males than fe- 
males graduate from college and a 
much larger percetdge oi males than 
females obtain graduate and profes- 
sional degrees The more advanced 
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the academic degree. Jthe less likely 
women are to receive it in most cases, 
as Illustrated m Table 1 for the three 
mathematics-related fields of statis- 
tics, computer/information science, 
and opefattons research 

Intervening Variable: Sex 
(Mscrimination in the 
Iducitional System 

"Sex discrimination" is a global vari- 
able which encompasses all the dif- 
ferential influences on males and fe- 
males which stem from independent 
variables in the model. The total 
amount of sex discrimination pro- 
duced or experienced will vary from* 
one individual to another and as a 
function of the particufar educational 
setting (school and surroun^ig com- 
munity) 

The two major categories SPThde- 
pendent variables included m the 
model, le the internal psychological- 
cognitive structures of individuals 
participating in the educational sys- 
tem and the educational system it- 
self, are linked through the mind-sets 
which participants, both students and 
educational personnel, bring with 
them into the system and v^hich 
shape their behavior as they partici- 
pate in tha system. 

Independent Variables 

Numerous independent variables are 
thought to contribute to sex discrim- 
ination and hence to sex inequalities 



in educational achievement and op- 
portunities, more detailed diagrams 
interrelating these variables are con- 
tained in Figures 2 and 3. 
Internal psychological-cognitive struc- 
Jures of indiv^uals who participate 
in the educational system The model 
emphasizes two major structures 
which predispose individuals (female 
as well as male) to define females in 
ways^leading to sex discnmination 

Sex-role orientation A normative 
view of appropriate behavior for males 
and females. Sex-role orientation can 
be conceptualized as a continuum of 
traditional to nontraditional ^attitudes 
about appropriate behavipr for males 
and females (Brogan & Kutner. 1976). 

Sex difference stereotypes- Percep- 
tions of "typical" characteristics (per- 
sonality traits, interests, etc ) and be- 
havior of males and females. The most 
damaging sex difference stereotype 
in our culture is the generalized view 
that females are less competent than 
males (Broverman. Vogel. Brover- 
man. Clarkson. and Rosenkrantz, 
1972). 

Sex-role orientation and sex differ- 
ence stereotypes are shaped during 
the individual's socialization by pri- 
mary group (family, peers) and by 
secondary group (larger society, eg , 
media) agents. During the socializa- 
tion process, the individual acquires 
shared cultural definitions of appro- 
priate behavior for his her gender and 



TABLE 1 

Total Number of Earned Degrees Conferred. 1974-75. 
and Percentage of Women Receiving Degrees, m Statistics. 
Computer/Information Sciences, and Operations Research 





Computer/Info 


Operations 


Statistics 


Sciences 


Research 


Total 


Total 


Total 


Degrees Women 


Degrees Women 


Degrees Women 



Bachelor's Degrees 



requiring 4 or 5 years 


213 


32% 


5039 


19% 


» 279 


4% 


Masjer's Level Degrees 


449 


24% 


2299 


15% 


489 


7% 


Doctor's Level Degreed 


158 


10% 


213 


6% i 


73 


3% 



Source 3aker.& Wells (1977) 
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FIGURE 2 

Independent Variables: Internal Psychological-Cog'nitive Structure 
of Individuals Who Participate in Educational System 
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FIGURE 3 

Independent Variables 
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of characteristics which are "mascu- 
line" and "feminine. " Yanico (1978) 
has^ recently discussed the signifi- 
cance drsubtTe nuances in I|('nguage 
for transmitting career information 
to young people, especially trans- 
mitting attitudes about sex-appropri- 
• ate careers. 

In addition to their. sex-role orien- 
tation and the content of the sex dif- 
ference stereotypes which they hold, 
individuals vary in ego strength, ie 
I ^ "such constructive qualities of the 
ego as resourcefulness and vitality" 
(Gump, 1972, p. 88) These three vari- 
ables in turn shape at least three addi- 
tional psychological-cognitive struc- 
tures which are highly relevant for 
educational achievement" self-con- 
cept, educational and occupational 
aspirations, and educational and oc- 
cQpational expectations. 
Educational system. All participants 
in the educational system — whether 
school board members, administra- 
tors, faculty, students, or students' 
parents — are molded*by the social- 
psychological processes described 
above. Thus, the educational system 
does not function Independently of 
the psychologi(^al-cognitive variables 
which have been identified. 

Elements within the formal struc- 
ture of schools wh»ch appear to func- 
tion, in discnminatory ways, e g , 
scheduling home economics classes 
for girls and shop courses for boys, 
have been exposed in recent years 
(Frazier & Sadker, 1^73, Harrison. 
1974), and efforts have subsequently 
been made to change these elements 
However, if young persons continue 
to believe that they "should not" 
aspire toward certain occupations or 
that they are not as qualified as 
members of the opposite sex to pur- 
sue certain occupations, sex mequal-^ 
ities in educational (and hence occu- 
pational) achievement will persist. 
Females' experience with respect to 
mathematics training provides a use- 
ful illustration of the interrelaUo.n of 
psychological-cognitive variaoles in 
producing underrepresentation of 
women m mathematics-related ca- 
reers. 
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Sex Differences in Mathematics 
Training: The "Critical Filter" 
EHect 

HiTton and Berglund (1974) reported 
successively lower mean mathemat- 
ics achievement scores for females. • 
as compared to males, at subsequent 
grade levels after grade five. In addi- 
tion, these researchers found signifi- 
cant differences by sex in interest 
in mathematics and science emerg- 
ing at grade nine. Freeman (1971) has 
argued that changes such as these ^ 
in girls' performance occur at a very . 
significant point in time, i.e. at the 
time when girls become avyare of 
what their adult status is supposed 
to be. Conceptions of what is "femi- 
nine" and vvhat is "masculine" are 
likely to narrow at this time (Neiman. 
1954). and the discipline of mathe- 
matics has been viewed as basically 
masculine (Feldman. 1974). Thus, 
one component of a girl's sex-roFe 
orientation may be that proficiency 
in mathematics is not appropriate 
for women. 

Correspondingly, a sex difference 
stereotype may be the belief that boys 
do better in mathematics than do 
girls. Ernest (1976), who studied stu- 
. dents in grades 2 through 12, found 
for the top four grades (9 through 12) 
that almost one-third of the sample 
(32 percent) believed that boys do 
better m math. Only 16 percent of^ 
the sample believed that girls do bet- 
ter in math, and 52 percent said that 
there was no differenc^ And among 
27 elementary and high school teach- 
ers questioned by Ernest (1976), 41 
percent felt that boys do better in 
math, while no one felt that girls do 
better. Dornbusch (1974) reported 
that among 1.886 high school stu- 
dents surveyed in San Francisco, 
more girls (26 percent) than boys (15 
percent) attributed receipt of a poor 
grade in mathematics to lack of abil- 
ity. Tobias (1976) has recently dis- 
cussed "math anxiety" as an "1 can't 
syndrome ' resulting in* math avoid- ^ 
ance. most frequently among fe- 
males. According to Tobias (1976). 
the problem stems^JrSrff "a culture 
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that makes math ability a masculine 
attribute, that punishes women for 
doing well m math, and that soothes 
the slower math learnef by teUmg 
her that she does not have a mathe- 
matical mind' ". (p. 57) 

If teachers, as well as students, ac- 
cept the stereotype of mathematics 
as a male domain, they are likely to 
expect a lower level of mathematics 
performance on the part of females 
and are less likely tq encourage fe- 
males to pursue advanced work in 
mathematics The educational sys- 
tem Itself then becomes structured 
in such a way that males' achieve- 
ment m mathematics is facilitated 
while females' achievement m mathe- 
matics IS seriously impeded 

Thus, to the extent that women 
dislike mathematics, lack confidence 
in their ability to perform m mathe- 
matics, and are not encourag ed t o 
achieve in mathematics, the criticb! 
filter effect described by Sells (1975) 
will operate to cut down the percent- 
age of women who will aspire toward 
careers in statistics, computer infor- 
mation science, operations research, 
economics, or other fields which are 
mathematics-related. 

CONCLUSION 

The principal value of the model lies 
in encouraging attention to factors 
outside the educational system itself 
which feed into the sexism said to 
characterize American education 
The potential significance of such 
factprs for specifying the dynamics 
of sex-specific consequences for 
educational attainment has recently 
been stressed by Alexander and Eck- 
land (1974, p. 680). Although the in- 
fluence on teachers and faculty of 
their own sex stereotypes is fre- 
quently recognized as contributing 
to sex discrimination in education 
(e.g., Safilios-Rothschild, 1974, 
Knight, 1973), the significance of sex 
stereotypes and sex role attitudes 
of students themselves is less often 
noted. Enforcement of regulations 
generated by the 1972 Education 




Amendments Act or Public Law 94- 
482 or a comprehensive assault on 
sexism within a particular school 
setting, as <lescFibed- by Harrison 
(1974), only deals with part of the 
problem. 

Occupational sex segregation in 
the U.S labor market continues to be 
pronounced According to the 1940 
census, 63 percent of all women in 
the labor force were in occupational 
categones in which 50 percent or 
more of the incu^be^its were female, 
by 1970, the coppparable figure was 
about 65 percent (Brito & Jusenius, 
1977) Moreover, for the most part, 
women continue to aspire to tradi- 
tionally female occupations. Brito 
and Jusenius (1977), reporting on 
the National Labor Survey of young 
women who in 1973 stated th#^ they 
expected to be in the labcfr force at 
age 35, fcnjnd that only 25 percent 
of white college women expected to 
be in an atypical (i.e traditionally 
male) occupation at age 35. Black 
college women (22 percent) and white 
noncollege wonjin^(19 percent) were 
even less likely toexpect to be in an 
atypical occupation age 35 

The implications for vocational 
education are obvious. Because of 
existing and future labor market op- 
portunities. It is important that young 
people be encouraged to consider 
entering expanding fields which have 
not typically been entered by mem- 
bers of their sex For example, a fa- 
vorable job market e^sis and un- 
doubtedly will continue to exist in 
mathematics-relate^ fields such as 
statistics and computer/information 
science. 

This may necessitate an upgrading 
of prevocational programs and, the 
counseling programs in high schools, 
designed to make students aware of 
the full range of career opportunities 
and the courses they must take m 
high school in order to keep all their 
options open. It may also mean that 
some students require encourage- 
ment to make up deficiencies There 
is extensive evidence that such en- 



couragement can be significant for 
female participation and performance 
levels in mathematics (Carey, 1958; 
Poffenberger & Norton. 1963; Xaven, 
1971, Fox. 1974. Kundsin. 1974. Blum, 
1975. MacDonaid. 1976, Tobias. 1976). 

Rather than serving a remedial 
role, however, it would be more eca- 
nomical if vocational educators could 
assist young people, particularly 
women, in avoiding "false starts." 
The author's research on women 
medical students (Kutner. & Brogan, 
in press) indicated ihat women stu- 
dents jwere more likely than men stu- 
dents to have entered medical school 
after changmg.their previous occu- 
pational plans or actual employment 
(including ''employment" as a wife/ 
mother). 

Brito and Jusenius (1977) state that 
"if young women are to move irito all 
types of typically male occupations, 
affirmative action programs are not 
sufficient. It'is necessary also to 
broaden young women's exposure to 
Wie full range of their employment 
opportunities" (p. 137). The same is 
probably true in the case of young 
men. Vocational educators have a 
crucial role to play in influencing 
students' sex-role orientation and 
sex difference stereotypes regarding 
"work* — two variables which oc- 
cupy a key position m the attainnrfent . 
process of educational equity. 
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INTRODUCTION 

Student attributes which directly in- 
fluence career choice are of direct 
interest to all educators; occupational 
status is one of the most crucial in- 
dicators of the individual's overall 
social welfare throughout life. Life 
style, social environment and social 
mobility are chiefly determined by 
one's occupation. Further, the stu- 
dents occupational desire is a basic 
ingredient in the choice of an educa- 
tional program in secondary school 
and plans for postsecondary educa- 
tion. Four specific student attributes 
were addressed in this study. (1) the 
student's career aspiration, (2) the stu- 
dent's career expectation, (3) the stu- 
dent's attitude toward the world of 
work and (4) the student's knowl- 
edge of the requirements of vanous 
occupations. The purpose of this re- 
search was to describe these four 
student attributes among eleventh 
grade students in Pennsylvania usmg 
data collected through the statewide 
Educational Quality Assessment Pro- 
gram (EQA). More specifically, this 
discussion focuses upon differences, 
when observed, between eleventh 
grade female and male student ques- 
tionnaire and test item responses. 
It is important for the vocational edu- 
cation community to know if female 
and male students comprise differ- 
ing populations regarding occupa- 
tional and, thus, educational choices. 

Results of this research are pre- 
sented separately for each student 



attribute studied. Emphasis through- 
out the study was upon differences 
between male and female student 
responses. The causes of the ob- 
served differences were not ad- 
dressed; nor was the relationship 
between the educational system it- 
self and the student responses 
studied. 

SAMPLE 

The data examined were drawn from 
student responses to questionnaires 
and test scores obtained by the EQA 
in years 1974, 1975 and 1976. Only 
eleventh grade student responses 
were studied to keep the scope of 
this report manageable and because 
eleventh grade students exhibited 
more stable and realistic career 
aspirations and expectations than 
did students from earlier grades. 

Durirrg the three year period be- 
tween 1974 and 1976, all high schools 
in the Commonwealth of Pennsyl- 
vania participated in the EQA pro- 
gram, one-third of all districts par- 
ticipating each year. In total, 147,813 
eleventh grade students were tested 
during this three-year interval. Be- 
cause of the large number of students 
tested, stratified systematic subsam- 
ples were drawn for convenience in 
performing complex statistical anal- 
yses. An ideal sample size for the' 
study of individual students was com- 
puted to be approximately 3,500. 
Exact figures for each year studied 
are provided in Table 1. 
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TABLE 1 

Sample Sizes of EQA Testing Programs in Pennsylvania 
for Selected Years Described by Sex 



Academic Year 



1973-74 1974-75 1975-76 







Number 


% 


Number 


% 


Number 


% 


Test Sample 


Total 


47,042 




60,129 




40,642 






Female 


23,583 


50.1 


27,485 


45.7 


18,212 


44.8 




Male 


22,527 


47.9 


29,120 


48.4 


19,553 


481 




Not Given 


932 


2.0 


3,524 


5.9 


2,877^ 


7.1 


Analytic Sample 


Total 


3,568 


D 


3,313 




3,311 






Female 


1,809 


50.7 


1,714 


51.7 


1,702 


51.4 




Male 


1,747 


49.0 


1,549 


46.8 


1.515 


45.8 




Not Given 


12 


0.3 


50 


1.5 


94 


2.8 



TABLE 2 

Occupational Fields Desired by Eleventh Grade 
Students Reported by Sex of Respondent 
(N = 3568) 





m 


Percent 






Percent 
Female 


Occupational 


Total 


of Total 


Male 


Female 


of Total 


Field ' 


Response 


Sample 


Responses 


Responses 


Response 


Health 


557 


15.61 * 


152 


405 


72.71 


Education 


227 


6.36 


' 51 


176 


77.53 


Industry- Factory 


103 


2.89 


94 


9 


8.74 


Construction 


297 


8.32 


278 


19 


6.40 


Transportation 


197 


5.52 


106 


91 


46.19 


Communication- 












Public Utility 


76 


2.13 


46 


30 


39.47 


Services 


414 


11.60 


257 


157 


37.92 


Environmental Services 


189 


5.30 


153 


36 


19.05 


Clerical 


391 


10.96 


21 


370 


94.63 


Sales 


32 


0.90 ' 


21 


11 


34.38 


Business 


166 


4.65 


, 101 


65 


'39.16 


Professional and 












Technical 


714 


20.01 


398 


316 


44.26 


Special 


84 


2.35 


4 


80 


95.24 


No Response 


109 


3.06 


65 


44 


40.37 


Sex' Not Reported 


12 


0.34 








TOTALS 


3,568 


100.0 


1,747 


1,809 


50 87 
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HNDIN6S 

Sax Diffarences in 
Occupitionil Aspirations 

The eleventh grade students identi- 
fied, from a list of 145 specific occu- 
pations, that one occupation most 
like the one They wish to follow 
when finished m'school, " The 145 
occupations were ,grouped into 12 
major occupational fields: health, 
education, industry-factory, construc- 
tion, transportation, communication- 
public utility, services, environmental 
services, clerical, sales, business and 
professional-technical. Student oc- 
cupational desires are reported in 
Table 2 for the 1974-75 academic 
year. 

More females than males desired 
jobs in the health, education and 
clerical fields. In fact, about 53 per- 
cent of all females desired jobs in 
one of .these three fields. About the 
same number of males and females 
desired jobs in the communication, 
professional-technical and transpor- 
tation fields; however, most females 
desired to enter the transportation 
fields as stewardesses Few female 
students desired to have jobs in the 
communication, environmental ser- 
vices or business fields. In general, 
almost no female students reported 
a desire to enter the industry-factory, 
construction or sales occupational 
fields. Only four percent of all female 
eleventh grade students desired the ^ 
role named "housewife." 

Few males reported a desire to 
enter the education or communica- 
tion*public utility occupational fields. 
Almost no males desired to enter the 
clerical or sales fields In general, 
male students desired a wider range 
of occupations than did female stu- 
dents. 

Of the total number of students 
surveyed, 49.3 percent aspired to an 
occupation which they knew required 
formal training (excluding appren- 
ticeship). Specifically, about 47 per- 
cent of all male students and 52 per- 
cent of all female students desired 



occupation^ which require formal 
postsecondary education. 

Generally, these eleventh grade 
students showed rather conventional 
and traditional male-female occupa- 
tional differences, males were more 
prone to desire practical, physical, 
psychomotor or managerial type oc- 
cupations, females tended to desire 
supportive, clerical and socially ori- 
ented occupations. 

Sax Differancas in Occupational 
Expactations 

The eleventh grade students did "not 
display any lack of occupational ex- 
pectation And, for the most part, 
students were optimistic about realiz- 
ing their occupational desires. Table 
3 shows the percentages of all stu- 
dents, female students and male stu- 
dents who expected to enter one of 
the 12 occupational fields About five 
percent of all students did not give 
an expected occupation — up slightly 
from the three percent of the same 
group of students who gave no de- 
sired occupation. 

For female students, the health, 
clerical, education, "special" (house- 
wife) and professionahtechnical fields 
accounted for 77 percent of all ex- 
pected occupations For male stu- 
dents, the professional-technical, 
services, construction, industry and 
business fields accounted for 66 per- 
cent of all expected occupations In 
each case it is clear that students 
tended to respond to' certain occu- 
pational labels possibly because of 
high visibility, frequent contact or 
glorification in the media Although 
the kinds of jobs expeqted by female 
and male students differed, the ten- 
dency for all students was to choose 
those occupational labels which are 
most familiar. Job titles in certain 
occupational field^especially in- 
dustry-factory) which are not familiar 
to the student were not expected by 
any students (le.. metal filer, inspec- 
tor of vehicles, dispatcher) ^ 
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TABLE 3 

Occupational Fields Expected by Eleventh Grade 
Students Reported by Sex of Respondent 

(N = 3568) 









1 




Dormant 




- 


Percent 






Female 


Occupatfonal 


Total 


OT lOtai 


Maie 


Female 


OT 1 Olal 


* Field 


Response 


Sample 


Responses 


Responses 


Response 


Health 


470 


13,17 


121 


/ 

349 


74.36 


Education 


242 


6,78 


63 


179 


73.97 


Industry-Factory 


172 


4.82 


157 


15 


872 


Construction 


283 


7,93 


274 


9 


3.18 


Transportation 


126 


3.53 


79 


47 


37.30 


Communication- 












Public Utility 


78 


2.19 


52 


26 


33.33 




t 1 u 


1 1 dQ 

1 1 


277 


133 


32.44 


Environmental Services 


153 


4,29 


132 


21 


13.72 




•t 1 0 








^94 ,47 


Sales 


47 


1.32 


31 


16 


^4.04 


Business 


190 


5 32 


128 


62 


32.63 


Professional and 












Technical 


525 


14.71 


312 


213 


40.57 


Special 


260 


7.29 


2 


258 


99.23 


No Response 


184 


5.16 


96 


88 


47.83 


Sex Not Reported 


12 


0,34 








TOTALS 


3.568 


100,0 


1,747 


1.809 


50.87 



TABLE 4 

The Realism of Occupational Goals of Eleventh Grade Students 
in Terms of Actual and Projected Labor Needs 







National 






State 






Per- 


Per- 






Per- 






centage 


centage 


Per- 


Per- 


centage 


Per- * 




Desired by 


of Actual 


centage 


centage 


of Actual 


centage 




Ail 


Jobs in 


Projected 


Desired by 


Jobs in 


Projected 


Category 


Students 


1974 


for 1985 


Students 


1974 


for 1^85 


Professional & 














Technical 














Workers 


49.2 


14.4 


15.5 


48.6 


13.8 


^ 14.2 


Clerical 


12.0 


17.5 


19,5 


11.3 


18.0 


19.3 


Managers, 














Officials & 














Proprietors 


12.3 


10.4 


10.5 


3.6 


9,1 


9,1 


Service Workers 


4.8 


13.2 


14,1 


11.7 


12.0 


12.6 


Sates Workers 


2.0 


6,3 


6.1 


0,9 


6.3 


6,2 


Craftsmen 


10.2 


13.4 


13.3 


11.2 


14.0 


14,0 


Operatives 


4.1 


16.2 


14,7 


3.3 


19.9 


18.6 


Laborers 


2.9 


5,1 


4.6 


0.7 


5,2 


4,8 


Farm Workers 


1.4 


3.5 


1,8 


1.3 


1.7 


1,2 



Source. National Center for Educational Statistics, Bulletin #26, 1977. 



Rialism of Occupational 
Expectations 

A picture of the occupational expec- 
tations of students when compared 
to the 1974 labor force composition 
and to the 1985 projections is pro- 
vided in Table 4. 
. The Pennsylvania figures mirror 
the national figures closely with the 
exceptions of the expected nunribers 
of managers, officials and proprie- 
tors. Relatively large discrepancies 
between occupational goals and oc- 
cupational possibilities were seen 
for all categories except service 
workers and farm workers in Penn- 
sylvania. Although 22 percent of 
PennsylvaPfja's students believed 
they will not work within their de- 
sired occupational fields, this per- 
centage of students with unrealized 
occupational expectations will be 
much higher according to the na- 
tional statistics Females reported 
expecting to enter what have tradi- 
tionally been considered male occu- 
pations in the professional-techni- 
cal, education, health and business 
occupational fields. However, no re- 
verse of this trend was evident. Males 
were not expecting to 'enter the tra- 
ditionally female occupations such 
as nursing, secretary, housekeep- 
ing, or, in any significant numbers, , 
teaching and social work. '^^-^ 

Sex Roles in Choice 
of An Occupation 

Why, does a student choose one of 
the 145 listed Occupations on the 
E'QA as desired or expected? Does 
this process of occupational choice- 
differ for male and female students? 
Two probable influences upon oc- 
cupation aspirations were studied. 
(1) the student's performance in 
school and (2) the student's family 
background. 

The single largest influence on 
the student's expected occupational 
y choice was what the student desired 
to'do. While the relationship be- 
tween what IS desired and what is 
expected wSs highly significant it is 
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not easily explained. Perhaps what 
the student desires determines what 
the student expects to attain in the 
world of occupations On the other 
hand, the job desired by the student 
may be highly influenced by what 
the student expects to attain; that 
IS, the student may practically limit 
occupational choice to those jobs 
which seem possible to attain given 
one's hopes, limitations, motivations, 
parental expectations and a variety 
of other personal considerations 
Most likely, the choice of occupa- 
tion IS made using both occupational 
desire and expectation, balancing 
the decision using the student's pres- 
ent situation and perceptions of the 
world of work. 

Of the variables surveyed by the 
EQA, the three stongest influences 
upon the student's desired occupa- 
tional choice were, in order of in- 
fluence: (1) expected occupation. 
(2) achievement in school and (3) the 
type of community (rural-urban) in 
which the student lives. However, 
the expected occupation, achieve- 
ment in school and place of residence 
for each student were themselves so 
closely related that a very good pre- 
diction of the occupational desire 
of a student can be made solely from 
that student's occupational expecta- 
tion. Achievement and place of resi- 
"9infce were far less influential upon 
the choice of desired occupation 
than was-occupatlonal expectation, 
generally, student^ who desired jobs 
which pay well and require postsec- 
ondary education were those stu- 
dents who expected to get those 
jobs, obtained the highest achieve- 
ment scores on the EQA and lived 
in urban areas of Pennsylvania While 
the influences on choice of desired 
occupation appeared the same for 
females and males* the occupational 
aspirations differed because male 
and female students have learned to 
expect differery types^f occupations 
Therefore, the observed differences 
between male and female occupa- 
tional desires appear not to be based 
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upon differing career choice proce- 
dures but on differing expectations 
of occupations available to males 
and females. The family environment 
{father's occupational level, mother's 
educational level, place of residence 
and parental attitude toward school) 
showed consistent influence upon 
the student's occupational choice- 
Very few students desired to enter 
the occupational field of their father, 
about 15 percent of the male students 
and 8 percent of the female students 
desired to enter their father's occu- 
pational field In fact, the occupation 
of the father (regardless of occupa- 
tional field) had a very small influence 
on the student's choice of desired, 
occupation. On the average students 
desired occupations with higher pay 
and educational requirements than 
the occupations of their fathers. For 
all students. 49 percent desired jobs 
with less pay and educational require- 
ments than their father's occupation 
and 51 percent desired occupations, 
with higher pay and educational re- 
quirements than the occupation of 
their father. 

Why did students choose an occu- 
pation which differed gr^ptly from 
their father's occupation in terms of 
pay and educational requirements'^ 
For males, the single largest factor 
examined was achievement in school. 
Those male students who received 
the highest scores on the EQA nnath 
and verbal achievement scales con- 
sistently desu-ed occupations with 
better pay and educational require- 
ments than the , occupations^ of their 
fathers. Further,] those male students 
who received iQw EQA achievement 
scores generally; desired occupations 
which paid less and had fewer educa- 
tional requirements than their father's 
occupation. This relationship also 
hofds for female students, however, 
the relationships between occupa- 
tional desire and school achievement 
was much stronger among male stu- 
dents than among female students 
A second significant influence on 
career choice was self-esteem. As 



with achievement scores, the EQA 
se|f-esteem score was significantly 
related to the difference between the 
student's ""occupational aspirations 
and the occupation of the father. 
Again, this relationship was stronger 
for males than females. Male stu- 
dents with the lowest self-esteem 
scores were also those male students 
who desired jobs which pay less and 
have lower educational requirements 
than the occupation of their father. 
Male students with above average 
self-esteem scores desired occupa- 
tions with pay scales and educational 
requirements far above those of their 
father's occupation. However, given 
equal self-esteem scores, female stu- 
dents reported lower career aspira- 
tions than did the male students 

Male-female student differences on 
choice' of expected occupation were 
also significcintly influenced by 
achievement in school and self- 
esteem Male students who expected 
to enter occupations with greater 
pay and educational requirements 
than the occupations of their father 
were^ those students with the highest 
EQA aiJhievement and self-esteem 
scores. Female students who ex- 
pected to attain an occupation with 
higrifer pay and educational require- 
ments than the occupation of their 
father were those with or^ly the very 
highest EQA achievem^r^and self- 
esteem scores. However, those fe- 
male students with the very lowest 
EQA achievement and self-esteem 
scores were also those female stu- 
dents with the very lowest occupa- 
tional expectations. Female students 
with only the very !;iighdst achieve- 
ment and self-esteem scores expected 
to enter occupations with greater 
pay and educational requirements 
than the occupation of their father, 
most females with average and above 
average achievement and self-esteem 
scores did not choose occupations 
with higher pay and educational re- 
quirements than those of their father's 
occupation. However, it may be some- 
what misleading to compare the §x- 
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pectations of female students with 
occupations of their fathers, compar- 
ing a femaie and male group will 
show lower expectations for the fe- 
male group. 

in summary,, the occupational de- 
sires of eleventh grade students in 
Pennsylvania were highly related to 
schooling effects, especially basic 
skills achievement and self-esteem. 
The EQA data revealed that occupa- 
tional desires of male students were 
consistently related to achievement 
and self-esteem, female students ap- 
peared to be most influenced fey ex- 
pectation of careers available to them. 
Male and female students at the elev- 
enth grade level appeared to make 
career choices based upon the same 
school and family factors. However, 
differences m "male and female stu- 
dent occupational aspirations at this 
level of schooling followed a welh 
established |:Jattern of occupational 
sexual stereotyping. 

Sex Differences in Vocational 
Attitudji Scores ni. 

Goal VIII of Pennsylvania's TemGoals 
of Quality Education reads, n ( 
■ Quality education should hdip every child 
understand the opportunities open to him 
or her to prepare for a productive life and 
help each child to take full advantage of 
these opportunities " 

Accordingly, Section VIII of the Edu- 
cational Quality Assessment is divided 
into two sections: Career Attitude 
and Career Awareness. Career atti- 
tude has two divisions; (1) Work Atti- 
tude, defined as "Willingness to give 
best efforts on a job, and belief that 
work leads to a sense of accomplish- 
ment in one's self," and (2) Career 
Planning, defined as Acceptance of 
the necessity of vocational planning 
and willingness to engage in, career 
planning activities." Career aware- 
ness IS described as "Knowledge of 
the duties, training, salary and edu- 
cational requirements of various 
occupations" 

Examples of survey items from the 
wor1< attitude (a) and Career planning 



(b) EQA subscales follow 

(a) The prospect of working most of 
my adult life depresses me. 

(b) My planning for a career IS a waste 
of time. 

(1) agree (2) mostly agree 

(3) mostly disagree (4) disagree 

Options (1) and (2) are unfavorable 
responses and options (3) and (4) are 
favorable responses The student 
score on this subscale is expressed 
as a total percentage of favorable 
responses. Thus, the Career Attitude 
subscales are criterion-referenced 
rather than norm-referenced There 
are 28 Items contained in this sub- 
scale, all of which are answered by 
one of the four options shown above 
Results for the 1974 group are dis- 
played as Table 5. 

Overall, females averaged about 
four points higher on this subscale 
than did males, a practically and sig- 
nificantly important difference. Fe- 
males scored higher on 12 of the 14 
-4ems under "Work Attitude" and sig- 
nificantly higher than mStles on 10 of 
those 12 Items Hence, females con- 
sistently earned equal or better 
scores than males for this section 

Generally, the percent favorable re- 
sponse was well over 50 percent For 
Item 28 males showed significantly 
more concern for ecirning power than 
did females. A similar pattern was 
noted for relajed item 15 " Females 
were more concerned than males 
with job satisfaction and accomplish- 
ment. Item 23 and 26 deal with actual 
work practices For these items, no 
significant male-female differences 
were observed In general, group fe- 
male and male responses to the Work 
Attitude Items were favorable to highly 
favorable. At least 90 percent of all 
students believed doing a job well 
IS important and will be gratifying 
About 90 percent preferred working 
to welfare as a life style. . 

The "Career Planning" items were 
not as discriminating on the sex vari- 
able as were the Work Attitude items, 
although 6 of the 14 items did show 
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a significant female-male response 
difference For each of these six 
items found significant, females 
scored higher than males. About 51 
percent of the eleventh grade stu- 
dents were "uncertain about which 
occupation to choose," this group 
being equally divided into males and 
females Significantly more males 
than females reported they would 
wait until out of school to decide 
upon an occupation, although this 
entire group comprised 15 percent 
of the total sample Males were also 
significantly more concerned with 
an uncertain future than were fe- 
males when deciding about a job. 
About the same number of females 
and males were threatened by mak- 
ing a definite career choice (41 per- 
cent of all students), yet 78 percent 
of all students had identified an 



occupation they wished to enter. But 
even at the eleventh grade level 30 
percent of all students (equal num- 
bers of females and males) reported 
stiil changing their occupational 
choices. While only 20 percent of 
all students reported not giving much 
thought to career choice, the signifi- 
cant majority of these students were 
male. Only 5 percent of all students 
felt planning for a career was a waste 
of time, yet 20 percent of all eleventh 
grade students reported not giving 
thought to career choice, 24 percent 
believed they will enter an occupa- 
tion by chance, and 9 percent be- 
lieved there is no need to plan for a 
career since something will come 
along sooner or later. " In each of 
these cases males were significantly 
nriore negative than were females 



TABLE 5 

Responses to Vocational Attitude — Goal Vlll-A, Grade 1 1 Section F, 
with Analysis of Variance for Sex 

Twenty eight items measure attitude toward work, career choice and efforts at establish- 
ing long range and educational plans Response options are (1) agree, (2) mostly agree. 
(3) mostly disagree and (4) disagree 

Percent Percent Mean Mean 
Response Favorable For For 
0) (2) (3) (4) Response Mates Females F-Test 

WORK ATTITUDE 
•1 The prospect of working 
most of my adult life 

depresses me 11 16 31 42 73 2.936 3.109 23 69 

•3 The only good part of a |0b 

IS the paycheck 12 18 32 38 70 2 823 3 085 53 44 

•4 I would not give my best 

efforts to a )ob if others at 

the )0b refused to do 

their best 6 10 31 53 84 3 132 3411 74 43 

•6 To me, the most important 
thing about work is the 

good feeling I get from It 37 41 14 8 78 2.903 3 182 \71.81 
•7 Doing a job well, day in 
and day out, is important 

tome 55 37 5 3 92 3.314 ^3,530 66.69 

•10^ I feel that working will 
give me a high sen^e of 

accomplishment , . 50 40 7 3 90 3.225 3 446 61-56 
13 If the money were not 
really needed, nobody 

would wof'k. , 22 24 26 28 54 2.542 2 601 2.29 
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•15. It doesn't matter which 
job i choose as long as it 
pays well 6 9 

*16. If I could live comfortably 
on welfare, 1 would not 
work 5 5 

18. If I won a state lottery 
($10,000 a year for life), 
Iwouldnotworkatajob. . . 13 13 

*20. I believe in working only 

as hard as I have to 14 18 

23. I often don't finish work 

I start 5 10 

26. I'm known as a good 

worker, no matter what 

the job Is 26 52 

•28. How much I earn is nny 

major consideration 

when I look at possible 

occupations 24 31 

CAREER PLANNING 
2. lam uncertain atx>ut 
which occupation to 

choose 28 23 

•5. I'm not going to worry 
about choosing an 
occupation until I'm out 

of school 7 8 

•8. I often wonder why I 
should try to decide upon 
a job wher^the future is 

so uncertain 18 25 

9. Making a definite career 

choice scares me 18 23 

11. I really can't find an 
occupation that has much 
appeal to me 9 13 

12. I know a great deal about 
the educational require- 
ments of jobs 16 32 

*14. My planning a career 

is a waste of time 2 3 

t *17. I probably will get into 

an occupation mostly 

by chance 9 15 

•19. I have not given much 

thought to a career 

choice 9 11 

)1. I keep changing my 

occupational choice 13 17 

22. 1 would not want to hold 

t^he same job for more 

than five or ten years — 6 10 

24. I doubt that I could keep 
interested In the same 

job over several years ..711 
•25. There is no need to plan 
for a career because 
something will come 
along sooner or later 4 5 
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27. I really don't know how 
to tie together my interests 
and abilities a^ ttiey relate 
* to a future job choice .... 19 27 29 25 



* Overall 



54 2.522 2,610 5,40 
55.946 59402 67,04 



• p < 0.001 

(Items marked by an asterisk show statistically significant male/'female responses.) 



Males and females in significant 
numbers expressed doubt, concern 
and difficulty with career planning. 
For the total sample. 51 percent of 
the students expressed uncertainty 
in choosing an occupation, 52 per- 
cent reported lacking knowledge of 
educational requirements of jobs, 
and 46 percent reported not knoVving 
how to tie together their interests 
and abilities as they relate to a future 
job choice Each of these groups was 
composed of almost equal numbers 
of males and females Hence, both 
sexes expressed similar difficulties 
with the career planning process. 

Sex Differences in Vocational 
Knowledge Scores 

EQA Goal Vlll-K, section G, measures 
the student's knowledge of the duties, 
training, salary and educational re- 
qujf*ements of various occupations. 
Two types of items were used match- 
ing and multiple choice The initial 
15 Items required the respondent to 
match occupation titles with appro- 
priate occupation descriptions (duties, 
attributes, educational requirements, 
psychomotor needs, etc.). The re- 
maining 20 items were multiple choice 
questions all of the form- 
1 Today there is a great need for, 
and short supply of, women in 

(a) law enforcement 

(b) teaching 

(c) construction 

(d) retail sales 

The student's score is the number 
of correct responses out of the 35 
possible points. This Is a norm-refer- 
enced scoring procedure. 

The average score on the voca- 
tipnal knowledge test for all students 



was about 16 (a student usually an- 
swers 16 of the 35 questions cor- 
rectly). The average number of ques- 
tions answered correctly by female 
students is 16.8 and by male students 
15.8. These total score averages for 
male and female students were sig- 
nificantly different at the -0.001 level 
(F = 24.61. df = 1,3266). In other 
words, for the Vocational Knowledge 
EQA subscale, female students aver- 
aged one more correct answer than 
did male students. However, as a 
group, female students answered 
about 48 percent of all questions 
correctly and male students ao- 
swered about 45 percent of all ques- 
tions correctly. Although female stu- 
dents answered more questions 
correctly than did males, both 
groups answered less than 'half the 
vocational knowledge questions 
correctly. 

Females showed superior ability 
bver males in matching job titles 
with job descriptions. The most 
known occupational requirements 
for this sample were (1) lawyer. (2) 
salesman. (3) mailman, (4) drill press 
operator, (5) teacher, (6) decorator, 
(7) principal, (8) practical nurse, (9) 
dietician, (10) newspaper editor, (11) 
dentist, (12) registered nurse. (13) 
sculptor, (14) insurance investigator 
and (15) funeral director. It would 
appear that most visible occupations 
are the best known to the students. 

Male-female differences for the 20 
multiple choice items followed spe- 
cific patterns. Males consistently 
scored significantly higher on those 
items which generally dealt with 
working conditions, salaries, and un- 
employment statistics. Females con- 
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sistently scored significantly higher 
on those items dealing With employ- 
ment opportunities and abilities re- 
quired for specific occupations. No 
differences were observed on those 
items dealing with job aptitudes, 
job benefits and specific require- 
ments'for general occupation fields. 
Both sexes scored very poorly on 
Items dealing with future employ- 
ment opportunities, the number and 
kind^ of jobs in the t6tal woriclo^^ 
and ur^employ ment rates f6r teen^^ 
agers. 

In general, it appeared that stu- 
dents deal with the world of work in 
terms of what is most familiar to them 
and what Is perceived to be true at 
present. There appeared to be httle 
student ability to deal with employ- 
ment opportunities and requirements 
in the future — even though the ma- 
jority of students will be entering 
the labor force or job market in the 
future. 

SUMMARY A(fD DISCUSSION 

The sexual inequalities observed on 
several variables in this study share 
a multitude of inputs and mter-rela- 
tionships. However, one thought 
holds constant, the student body it- 
self i&^a source of vocational in- 
equity ^Emphasizing the role of the 
indivKfual when studying sex differ- 
ences in vocational education is an 
important initial step. 

Results of this study revealed that 
the internal structure of the student 
played a significant role in occupa- 
tional choice. Of more importance 
was the realization of how the inter- 
nal structures of male and female 
students differed on the variables 
observed Also, study findings made 
quite clear how these male/female 
internal differences led to other ob- • 
'•Served differences. For instance, 
levels of self-esteem and achieve- 
ment*measured in males and females 
played a differingN^ ia/^c^WJa- 
tional aspirations ana^&)<pa©ttftions. 
Female stucjgnts appeared to accept 
a lower locus of control than did 
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male students in choosing a voca- 
tional role. This was further con- 
firmed by comparing reported career 
aspirations with career expecta- 
tions. Female— students reported 
aspirations nearly as high as those 
of males, however, female expecta- 
tions were lower than male ^expec- 
tations. Both female and male stu- 
dents still very much accepted the 
traditional sex rotes and stereo- 
type«-when choosing a career. While 
4en)a\e students reported increased 
aspirations In traditionally male- 
dominated occupational fields, male 
students revealed no such movement 
toward traditional female-dominated 
fields. Perhaps the tradition of "mas- 
culine" occupations will be easier 
to overcome than the tradition of 
"feminine" occupations. 

Male and female students also dif- 
fered significantly in their response 
to items measuring attitudes toward 
work. Male students showed a higher 
level of concern for earning power 
and job security than did female stu- 
dents, and female students reported 
greater concern for. job satisfactibn 
and accomplishment than did male 
students. Career planning patterns' 
were virtually the same for male and 
female students, jlespite signifi- 
cantly different career aspirations 
bett^een these groups. Both sexes 
expressed difficulties with the career 
planning prdcess. 

Female students responded ca^ 
rectly to vocational knowledge items 
more often than did male students 
However, female and male students 
differed significantly on types of 
items answered correctly. Female 
students were more cognizant of em- 
ployment opportunities and abilities 
required for specific occupations 
while male students were more cog- 
nizant of working conditions, sal- 
aries and unemployment statistics. 

Observing the individual student 
when studying sex inequity iri voca- 
tional choice is the more empirical 
method of determining the source, 
of the inequity, although the choice 
of specific variables for study re- 



mains a crucial problem. The indi- 
vidual is the basic unit Of study be- 
cause perceptions of inequality, levbl 
of sexual stereotyping, and conse- 
quence of discrimination always 
varies over individuals. Also the stu- 
dent's perception of inequality, 
stereotyping, or discrimination af- 
fects external behavior. Monitoring 
such behavior is an ingredient in 
the planning and implementing of 
the vocational education process. 
It is very likely that observed changes 
in student perceptions ahd behavior 
win lead to changes in vocational 
programs. 
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Sex-Role Perceptions of Vocational Educators: 
A Variable in Achieving Sex Equity 



JENNETTE DITTMAN 
University of North Dakota 

Human equality is one of the basic 
values upon which our nation was 
founded. Yet, equal oppbrtunities 
for females and males vocational 
education have as yet to be realized. 
The Congressional Hearings on Sex 
Discrimination and Sex Stereotyping 
in Vocational Education (1975) pro- 
vided ample evidence of the exis- 
tence of pervasive sex discnmination 
throughput the entire vocational edu- 
cation system This social injustice 
continues in spite of laws such as 
the Equal Pay Act of 1963. Civil 
Rights Act of 1964, Equal Employ- 
ment Act of 1972 and Title IX of 
the 1972 Education Amendment Act 
which have been enacted to provrde 
legal protection against sex dis- 
criminatioh. Recognizing the impor- 
tance of these issues, the Education 
Amendments of 1976 have incorpo- 
rated throughout 'a theme of elimi- 
nating sex discrimination, bias, and 
.stereotyping in vocational education. 
Not only must the mandated policies 
be met, but affirmative action must 
be taken by vocational educators, to 
assure equal access to programs by 
females and males, overcome sex 
discrimination in programs and oc*Cu- 
patrons, encourage enrollment in 
non-trad itional courses, and provide 
inservi^e training for guidance coun- 
selors in non-sexist counseling 

These provisions have raised criti- 
cal questions with state boards, agen- 
cies and schools on how to meet the 
requirements to provide open and 
equal vocational education oppor- 
tunities for all §t«Kjents Outright and 
blatant examples of discrimination 
may be dealt with expeditiously and 



eliminated through legal means. How- 
^ ever, convincing evidence exists'that 
students are continuing to experience 
differential treatment and opportu- 
nities based on their sex. Vocational 
educators must look deeper and per- 
haps in new ways at their assumptions 
and practices if these inequalities 
are to, be fully corrected The concep- 
tual model suggested by Kutner and 
Brogan (1976) has presented a frame- 
work which may be useful to examine 
pertinent variables which appear to 
contribute to sex discrimination in 
vocational education and perhaps 
more importantly, has provided the 
means of clarifying relationships 
among variables. 

There is ample evidence that sex 
discrimination do^s exist m voca- 
tional education with subsequent 
sex inequalities in vocational edu- 
cation opportunities and achieve- 
ment (Congressional Hearings on 
Sex Discrimination and Sex Stereo- 
typing in Vocational Education, 1975, 
Parrott, 1975, Project on Equal Edu- 
cation Rights, 1978, Steele. 1974. 
Steiger, 1975). These same sources 
indicate that inequalities have in 
turn provided pre-conditions for sex 
inequalities in occupational oppor- 
tunities and attaiornent If prediction 
and control of these inequalities are 
to be achieved, changes must be 
made in the independent variables 
presented in the model. 



EDUCATIONAL SYSTEM 

Sex-role perceptions are an integral 
part of the educational system m 
which vocational education takes 
place. These perceptions can be a 
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significant source of sex bias, thus 
reflecting the underlying assump- 
tions held by individuals about sex 
roles and sex differences. If these 
assumptions are based on stereo- 
typed perceptions of maleness and 
femaleness, students will continue 
to be restricted in thejr, individual 
development and vocational educa- 
tion opportunities. 

Sex bias has beeh expressed m 
the formal vocational educational 
structure through restrictive enroll- 
ment practices, counseling practices, 
vocational guidance tests, curricular 
offerings, learning resources, and 
staffing patterns (Congressional Hear- 
irijpon Sex Discrimination and Sex 
^IFreotyping m Vocational Educa- 
, tion. 1975, National Institute of Edu- 
cation. 1974, Project on Equal Edu- 
cation Rights. 1978). Specific and 
observable discriminatory acts are 
illegal and are being changed. For 
example, students have the legal right 
to enroll in any vocational program; 
however, this has essentially been 
true for most programs in the past,. 
Kaufman (1975) concluded after ten 
years' involvement in various voca- 
tional education projects, that doors 
have been open for males and fe- 
males to enter nontraditional pro- 
grams, but they had not and were 
not going through these doors to 
any great extent 

Sex bias reflected in schools* in- 
formal day-to-day activities and 
interactions are restnctmg students' 
vocational opportunities and achieve- 
ment as effectively as the formal 
barriers Stereotyped sex-role per- 
ceptions have acted as a screen pre: 
venting educators from being aware 
of the sources of discrimination in 
their own behaviors and in schools' 
programs, practices, and policies 
Informal counseling of students into 
programs which fit traditional sex- 
role vocational expectations and the 
absence of counseling to help stu- 
dents evaluate their views of chang- 
ing sex-roles in relation to widened 
curricular and vocational options 



have been frequently cited as evi^ 
dence of practices which lead to 
unequal vocational opportunities 
and achievement. Teachers exert 
overt and covert pressure upon those 
who depart from the traditionally ac- 
cepted sex-role vocational expecta- 
tions. These students are often has- 
sled by both teachers and their 
peers. In addition, in many cases, 
direct and indirect messages are 
conveyed that females need not and 
should not have serious career aspi- 
rations (Kaufman, 1975, Parrott, 1975, 
Pierce, 1975, Roby, 1975, Steele. 
1975: Steiger. 1975). 

INTERNAL I^YCHOLOGICAL 
COGNITIVE STRUCTURES 

A variable cited in the Congressional 
Heanngs as being critical to the elim- 
ination of sex discrimination in vo- 
cational education was the stereo- 
typed sex-role perceptions held by 
educators. These perceptions form a 
body of assumptions about sex roles 
and sex differences which unavoid- 
ably affect ail aspects of students' 
educational experiences. A student's 
perceptions of what it means to be 
a male or female is also a crucial 
variable in the process of sex dis- 
cnmination. Kutnerand Brogan (1976) 
have suggested that sex-role orien- 
tation occupies a key position iit the 
model and that' changes m that vari- 
able will utimateiy affect all other 
variables in the system. 

The commonly used concept, sex- 
role Sitereotypes. has been subdivided 
by Kutner and Brogan into the two 
constructs, sex-role orientation and 
sfx difference stereotypes. Both are 
important components in an individ- 
ual's internal psychological-cognitive 
structure and are significant compo- 
nents in the formation of individuals' 
self concepts and ego strength. All 
these constructs inter-relate to affect 
the educationaLdnd occupational 
aspirations and expectations of stu- 
dents. Thus, one's perceptions of 
societal expectations for appropriate 
male-female behaviors and one's per- 
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ceptions of differences between males 
and females are pivotal variables in 
the Cham of factors that relate to 
produce sex discrimination and in- 
equalities in vocational education. 

The literature on sex roles and sex- 
role stereotyping produces extensive 
evidence which raises questions 
about the viability of traditional sex- 
role perceptions based on the view 
that masculinity and femininity are 
complementary bipolar qualities. 
Rather than emphasizing the differ- 
ences between the sexes, a number 
of researchers and writers have sug- 
gested that the relationship between 
sex roles and personality be reframed 
so that similarities and commonali- 
ties shared by the sexes may be in- 
vestigated (Bardwick, 1974. Bem. 
1974, 1976, Kaplan & Bean. f976. 
Rebecca. Hefner & Oleshansky. 1976). 

Bem (1974. 1976) has proposed the 
model of androgyny as a more flex- 
ible and humanistic framework from 
which to examine individual person- 
ality.. Using this model, individuals 
may incorporate into their personal- 
ities and express both the tradjtion- 
ally assigned masculine and/or .femi- 
nine characteristics, depending on 
the situational appropriateness of 
these behaviors Thus, individuals 
would be freed to develop their own 
unique qualities and interests un- 
hampered by the restrictions of rigid 
sex-role stereotypes 

Bem s research has produced evi- 
dence verifying and validating the 
model of psychological androgyny 
(Bem, 1974. 1976) The development 
and use of the Bem Sex- Role Inven- 
tory (Bem. 1974) has provided an 
operational definition of androgyny 
and produced evidence confirming 
the existence of androgynous indi- 
viduals (Bem, 1974. 1976) 

SEX- ROLE PERCEPTIONS 
OF VOCATIONAL EDUCATORS 

Research has shown that teachers', 
counselors . and* administrators' atti- 
tudes and values are a significant 
influence upon students (Leacock. 
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1969, Minuchin. Biber, Shapiro & 
Zimiles, 1969, Brophy & Good, 1970, 
Rosenthal & Jacobson. 1968). Expec- 
tations^and attitudes concerning ap- 
propriate sex-role behaviors are con- 
veyed through the reinforcement or 
non-reinforcement of sex-stereotyped 
behafviors (Lee & Kedar, 1974) Differ- 
ing expectations are held for male 
and female students which influence 
the intellectual, social, and emotional 
development of students (Ricks & 
Pyke, 1973, Sadker & Sadker, 1974. 
Steele, 1974). Testimonies in the 
Congressional Hearings on Sex Dis- 
crimination and Sex Stereotyping in 
Vocational Education (1975) cited 
the stereotyped sex-role perceptions 
of vocational educators as a factor 
crucial to te elimination of sex dis- 
crimination. The lack of specific 
research .data on which to base the 
planning and implementing of cor- 
rective measures was also presented 
as an important impediment to re- 
ducing inequalities in vocational 
education. Kutner and Brogan stated. 

as attitudes about appropriate be- 
havior for females and males become 
more flexible, all other variables in 
the system will correspondingly be 
affected" (1976, p. 67) Knowledge 
of educators' sex-role perceptions 
is a necessary first step to predicting 
and controlling inequalities in voca- 
tional education. The study which 
follows (Dittman. 1976) sought to 
provide empirical data concerning 
the sex-role perceptions of voca- 
tional educators in North Dakota. 

PROCEDURE 

A stratifed random sample of 517 was 
drawn from the population of 1,860 
vocational teachers, counselors, and 
administrators in North Dakota. The 
final sample was composed of 396 
educators of 76 6 percent of those 
originally contacted. 

The Bem Sex Role Inventory (BSRI) 
(Bem, 1974) was selected to assess 
the sex-role perceptions o'f the voca- 
tional educators in this study The 
BSRI was developed to measure indi-- 
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viduals' perceptions of their own sex- 
roles It has also been used to assess 
individuals' perceptions of others 
sex roles (Campbell, Katrin & New- 
nrian. in process; Deutsch & Gilbert. 
1976). Vocational educators in this 
study were asked to mark th6 BSRI 
three times to indFcale fhelr sex-role 
perceptions of themselves, an adult 
male/and an adult female 

Normative data for the BSRI are 
bas^d on its administration to more 
than 2000 undergraduate college 
and university students The Mascu- 
linity scores and Femininity scores 
are empincally, as well as concep- 
tually, independent (average r = 
- 03) Th?T -ratio is internally con- 
sistent (average r 93), and uncor- 
related with the tendency to describe 
oneself in a socially desirable direc- 
tion (average r = - 06) 

The BSRI contains 20 masculine, 
20 feminine and 20 neutr^^djectives 
Means are calculated f^j^^ach sub- 
ject's ratings of the masculine and 
feminine adjectives producing a mas- 
culinity and a femininity score The 
difference between the Masculinity 
Score and the Femininity Score is 
used to calculate the Androgyny (f- 
ratio) score The greater the absolute 
value of the androgyny score, the 
more sex-typed a per's'57r't5--^he 
closer the score is to zero, the moVe 
androgynous a person is Cut-off 
pornts for classifying subjects in 
terms of the Androgyny (f-ratio) 
scQre are presented in Table 1 (Bem, 
1974) 



TABLE 1 

Bem's Sex Type Classification Using 
the Androgyny (t ratio) Score 



Androgyny (f ratio) 
Se)cType Score Cut-Off 



Classification 


Points 


Feminine (f) 


t ^ 2.025 


Near feminine (nf)- 


1< t < 2.025 


Androgynous (a) 


-1 :S t 5 -f 1 


Near masculine (nm) 


-2.025 < t < -1 


Masculine (m) 


t :s -2 025 



(Bem, 1974, p. 161) 



RESULTS OF THE STUDY 

Data from the study produced evi- 
dence that the vocational educators 
in the study sample were highly con- 
sistent in their sex-role perceptions 
of males and females. These percep- 
tions did not differ significantly ac- 
cording to the subjects' sex. occupa- 
tional group, program area specialty, 
or school level employed (secondary 
or^post-secondary) 

Subjects in all sub-samples viewed 
males as masculine typed and fe- 
males as feminine or near-feminine 
typed indicating predominantly ste- 
reotyped views of others' sex roles 
(Tables 2 and 3) As noted m the 
Kutner and Brogan model, these per- 
ceptions could be a significant 
source of sex discnmmation in the 
formal and informal structure of 
schools as vocational educators 
plan and carry out their programs. 



TABLE 2 

Sex-Role Perceptions of Males, Females, and Self 
by Male Subjects and Female Subjects 



Mean A-Score Mean A-Score * Mean A-Score 

Sex n Self" n f/ales* n Females* 



Males 296 -1 846(nm) 297 -3 090 (m) 296 2.300 (f) 

Females 97 0 380 (a) 96 -3.34g (m) 97 1 947 (nf) 

' Letters m parentheses indicate sex type classifications using Bem s suggested cut off 
points (See Table 1) ^ 
•p< 05 
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TABLE 3 

Sex-RoJe Perceptions of Males and Femades by Teachers 



of Various 


program Area Specialties 








Mean A-Score 




Moan Av^pnrP 






iviaies 


n 




Agriculture 


37 


-3.146 (m) - 


37 


^625 (f) 


Distributive education 


22 


-3.012 (m) 


22 


2.466 (f) 


Home economics 


54 


-3.492 (m) 


54 


2.038 (f) 


Industrial arts 


36 


-3.011 (m) • 


36 


-2.155 (f) 


Office 


25 


-3.349 (m) 


25 


2.247 (f) 


Special needs 


18 


-3.816 (m) 


18 


1.475 (nf) 


Trades and industry, and health 


53 


-2.897 (m) 


53 


2.001 (nf) 



• Letters in parentheses indicate sex type (Bem, 1974). (See Table 1) 



Both male and female subjects de- 
scribed other males and females as 
being significantly more sex-typed 
than they perceived themselves to 
be (Table 2). The force of traditional 
societal sex-role norms rs reflected 
In this finding. Although subjects in 
the study interpreted themselves as 
deviating from these norms, they 
assumed that others were not. These 
VQcational educators need to be made 
aware of the discrepancy between 
their perceptions of themselves and 
those of others and how this differ- 
ence could limit students' develop- 
ment and produce inequalities. The 
data also raise questions about the 
assumption that perceptions of one's 
own sex role are an accurate predic- 
tor of one's perceptions of other's 
sex rqjes. 

DISCUSSION 

These data along with that from 
selected research studies using the 
BSRI can help to determine a more 
accurate picture of perceptions of 
contemporary sex roles (Table 4). 
A majority of subjects in all of these 
samples were viewing their own sex 
roles in a non-stereotyped way pro- 
viding evjdence^that ind^duals are 
diverging in their own/ sex roles 
from traditional societal norms. The 

i^two studies using North Dakota high 
school students as subjects (John- 
sonr"1976; Sorensen, 1976) provided 

' evidence jhat only 16 percent and 



17.5 percent of the female students 
and 22 percent and 41.5 percent of 
the male students in these samples 
perceived their sex roles as express- 
ing traditional norms. In contrast, 
the North Dakota vocational educa- 
tors in the study conducted by Ditt- 
man (1976) perceived males and fe- 
males in a predominantly stereotyped 
manner. 

These findings when related to the 
Kutner and Brogan model raise ques- 
tions about the relationships between 
the* variables, students' sex-role per- 
ceptions and educators' sex-role per- 
ceptions of males and females. Al- 
though conclusions from the Dittman 
(1976), Johnson (1976), and Sorensen 
(cited in Johnson, 1976) are limited 
to the studies* samples and caution 
must be used in interpreting and 
generalizing from these data, the 
findings point to the need for addi- 
tional research to investigate the 
congruity between the way students 
viewed their sex roles and the way 
teachers saw students* sex roles. 

A study by Cattanach (1979) sought 
evidence to provide an answer to the 
question of how teachers' percep- 
tions of students* sex roles differ 
from students* perceptions of their 
own sex roles. Home economics co- 
operating, teachers, home economics 
student teachers, and their male and 
female students were subjects for 
this study. The BSRI (Bem, 1974) was 
used to assess subjects* sex-role 
• perceptions. 
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-TABLE-4- - 

Sex-Role Classifications of Subjects from Selected 
Research Using the Bern Sex-Role Inventory 



North Central 
High School 
(Johnson, 1976) 



Fargo South 
High School 
(Sorensen, 1976) 



Stanford 
University 
(Bern, 1974) 



Foothill Junior 

College 
(Bern, 1974) 



North Dakota 
Vocational 
Educators 
(Dittman, 1976) 





Males 


Females 


Males 


Females 


Males 


Females 


Males 


Females 


Males 


Females 


Classification 


(n « 67) 


Jn = 70) 


(n = 91) 


(n = 105) 


(n = 444) 


(n -279) 


(n = 117) 


(n = 77) 


(n = 296) 


(n = 97) 


% Feminine 


0 


16 


0 


17.5 


6 


34 


9 


40 


3 


14.5 


% Near feminine 


9 


24 


3 


30.5 


5 


20 


9 


8 


1 


22 


% Androgynous 


36 


40 


25.5 


27.5 


34 


27 


44 


38 


26 


42 


% Near masculine 


33 


10 


29 


15 


19 


12 


17 


7 


22 


14.5 


% Masculine 


22 


10 


41,5 


9.5 


36 


'8 


22 


8 


48 


7 



00 
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Teachers and student teachers 
Viewed female students' sex roles 

.as feminine-typed, and teachers 
saw the sex roles of male students 
as masculine-typed. These percep- 
tions thus reflected society's stereo- 
typed norms for males and females. 
In contrast, female students viewed 
their own sex roles as androgynous 
while males saw themselves as near- 
masculine Thus teachers and stu- 
dent teachers were perceiving female 
students and teachers were viewing 
male students as significantly more 
sex typed than students saw them- 
selves This discrepancy indicated 
that teachers were functioning with 
assumptions regarding students' 
male and female roles that were 
more restrictive than the perceptions 
the students had of their own sex 
roles A similar situation appeared 
to exist with student teachers' views 
of female students Thus, altho\jgh 
these students saw their own sex 
roles in a less traditional way, the 
teachers' and student teachers' ste- 
reotyped views could restrict the 
students from developing individual 
qualities and interests or from ex- 

^ ploring the expanded vocational op- 
portunities wich are now legally open 
to them In applying this to the Kutner- 
Brogan model, it is possible that 
change is one variable (students' sex- 
role perceptions) could be negated 
by the lack of change in another 
variable (educators' perceptions of 
students' sex roles) Thus, interven- 
tion measures need to be made synul- 
taneously with both variables. 

On the other hand, the study pro- 
duced evidence that student teachers' 
perceptions of male students' sex 
roles (near-masculine) and the male 
students' view of their own sex roles 
(near-masculine) were not signifi- 
cantly different In this situation, the 
student teachers had the potential 
to support and reinforce the male 
students' more flexible perceptions 
of appropriate malQ behaviors and 
provide experiences for them and 
other students to become aware of 
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the concomitant expanded possibili- 
ties for personal and vocational 
development. 

Data from these studies need to 
be viewed in relation to previous 
research findings that have supported 
the conclusion that the teacher is 
the most influential variable m the 
classroom m defining possibilities 
for student learning. The teacher 
holds the power and makes decisions 
which determine not only the curricu- 
lum, but also the classroom learning 
climate. The teacher thus has the 
potential to reinforce society's tra- 
ditional sex-role stereotypes and keep 
students within the prescriptive limits 
or to provide opportunities for stu- 
dents to explore new options and 
develop their own individual quali- 
ties and interests unhampered by 
pre-ordained sex-role expectations. 
Teachers could provide a significant 
source of support for students to 
move in the direction of androgyny, 
if the teachers could see students as 
having this potential. As shown by 
the data presented, the vocational 
educators in the study by Dittman 
(1976) who viewed males and females 
m a predominantly sereotyped way 
and the home economics teachers 
m Cattanach's study (1979) who were 
seeing male and female students' 
sex roles as highly sex-typed were 
not perceiving these possibilities. 

The teachers, student teachers and 
female students m Cattanach's study 
viewed their own sex roles as an- 
drogynous. The potential existed for 
these grloups to share their personal 
percepuons in an atmosphere of mu- 
tual understanding and support 
and move forward together to ex- 
panded personal and vocational de- 
velopment. However, the teachers 
and student teachers in viewing their 
female students' sex roles as stereo- 
typed could erect consciously and 
unconsciously effective barriers 
against allowing this to happen. 

Educators' sex-role perceptions are 
an important factor in affecting other 
variables that produce discrimina- 



tion, consequently, teachers, coun- 
selors, and administrators would be 
advised to become aware of their 
own sex-role orientation and examine 
'sex-difference stereotypes. They need 
to recognize the relationship between 
these perception^, and other vari- 
ables such as students' sex-role 
orientation, ego strength, self-con- 
cept and educational occupation)^ 
expectations. Unless affirmative step^- 
are taken to challenge educators m 
this way, sex inequalities will con- 
tinue to be a reality in vocational 
education. 
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Reverse Sex Stereotyping Case in Point: 
Court Reporting 



MARCIA A. ANDERSON and 
BEVERLY A. STITT 
Southern Illinois University 

INTRODUCTION 
Nature of the Problem 

Vocational education \s on the thresh- 
old of inclusion into the general edu- 
cation core, a trend clearly evidenced 
by the 1972 and 1976 Education 
Amendments. While this trend is a 
welcome one for vocatfonal educa- 
tors, the accompanying regulations 
must not be overlooked. According 
to Title IX of the 1972 Educational 
Amendments, No person . . . shall 
on the basis of sex, be excluded from 
participation ir>, be denied the bene- 
fits of, or be subjected to discrimina- 
tion under any education program or 
activity receiving federal financial^ 
assistance. " Sections 86.21 and 86.23 
state that comparable efforts must 
be made to recruit members of each 
sex. Section 86.36 states that dis- 
crimination on the basis of sex is not 
permitted in counseling or guiding 
students. Further, whenever a school 
finds that a class has a dispropor- 
tionate number of students of one 
sex. It must take whatever action is 
_necessary to assure that sex bias in 
counseling or testing is not respon- 
sible, as stated, "A recipient may be 
required to undertaka additional re- 
cruitment efforts for one sex as 
remedial action." 

Sex stereotyping is, usually evi* 
denced by women being groomed, 
guided, and encouraged in tradi- 
tional I6w prestige, low income, sub- 
ordinate role occupations. This has 
resulted in a large number of studies 



done to show the successes and fail- 
ures in changing this pattern (Hauei- 
sen, 1975; Smith, 1976; Beach, 1977). 
But half the working population ts 
male (Ellis,' 1977) and they, too, may 
be manipulated into career choices 
by sex stereotyping. Usually, these 
manipulations are to the male advan- 
tage In that they are led to the occu- 
pations with higher prestige, higher 
pay, and greater leadership poten- 
tial. It is' evident that some progress 
has been made in overcoming sex 
stereotyping in encouraging males 
to consider non-traditional occupa- 
tions. It is common to see male air- 
line stewards and many hospitals 
employ male nurses, but the fact 
remains, it is difficult to convince 
^most males that they have been 
denied desirable privileges, such as 
changing hospital bedding or typing 
and filing for eight hours a day 
Vocational education enrollnf>ent still 
shows that over 90 percent of the 
enrollment in the areas of agricul- 
ture, technical, trad6 and industry 
is male and over 85 percent of the 
enrollment in home economics,^office 
education, and helath is female (Ellis, 
1977; Allen, 1976). 

The desired result of non-traditional 
occupational experiences is not just 
balance, but an upgrading of the oc- 
cupations as a whole in the areas of 
prestige, pay, and leadership poten- 
tial so that individuals are attracted 
to the field regardless of sex The 
purpose behind the new legislation 
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and studies, then, js to be sure that 
sex stereotyping is not a factor in 
career choice. 

Members of the* court reporting 
profession have noticed changes 
in the sex ratio of the student profile 
during the last 10 to 15 years. This 
occupation, which for a number of 
years was primarily male-dominated, 
seems to have become female-domi- 
nated (Karpowicz, 1977; McFate, 1978; 
Peppey, Glassbrenner & Palmer, Note 
1) A 1973 report of a survey of court 
reporting schools indicated male 
enrollment of anywhere from 30 per- 
cent to none, with a majority report- 
ing about 10 percent male students 
(McFate, 1978) 'Also, the only lllinDis 
state supported court reporting pro- 
gram, located at the School of Tech- 
nical Careers of Southern llliriois 
University, Carbondale, shows a 100 
percent female student population. 
Yet professional journals include 
pleas for more court reporters, par- 
ticularly men (Karpowicz. 1977) If 
this sex ratio shift is valid, here is a 
more easily observable case tq,^§x- 
amme for stereotyping, actually a 
classical example of reverse" sex- 
role stereotyping may have occurred. 
At the December. 1977, meeting of 
the National Shorthand Reporters 
Association Board on Approved Re- 
* porter Training in St, Louis. Missouri, 
this phenomenon was b-rought up 
for discussion No consensus was 
reached to explain the apparent shift 
in, sex ratio during the last 10 to 15 
years. 

It IS true that our attention has 
been drawn to sex-role stereotyping 
and sex bias primarily because of 
the problems experienced by women 
However, it is important that we de- 
velop and maintain a balanced per- 
spective on the elimination of stereo- 
typing for men as well as women. 
Men may perceive opportunities for 
contribution and satisfaction in occu- 
pations dominated by females Men 
as well as women may be hurt by 
occupational sex-role stereotyping 
The goal is not to change the stereo- 



typing, but to eliminate it and gam 
equality of opportunity jn vocational 
education and employment of all 
students. 

PURPOSE OF THE STUDY 

The purpose of the study was to 
analyze the phenomenon, of "re- 
verse" sex stereotyping in vocational 
education, more specifically, court 
reporting and court reporting edu- 
cation in Illinois. 

Summary of Related Literature ^ 

Several general conclusions were 
drawn from the analysis of the liter- 
ature reviewed for this study. Social 

'psychologists 'were adamant that sex 
stereotyping is a powerful stratifier 
in our society. Language specialists 
have shown again and again the 

, power of our language, ^n sex-image 
production. Beach (1977), Ellis (1977), 
and others were convinced that ste- 
reotyping would not just go away. 
Rather, organized efforts were neces- 
sary to achieve sex fairness. Though 
sexism m written materials was well 
on its way to being eliminated, efforts 
needed to continue in this endeavor. 
Independent research and nation- 
wide studies pointed^to the overtly 
stereotyped guidance materfals and 
practices. But even sex-fair materials 
could do little to eliminate sexis,t 
counseling practices unless they 
were translated into training pro- 
grams for the counselor to better 
understand the changing roles of 
men and women in the world of work. 
Previous projects have shown that * 
non-traditional education was suc- 
cessful for females and that recruit- 
ment needed to be improved over 
time. This should surely apply to 
males as well. Consequently, sex 
stereotyping and its effect on males 
needed to be examined. 

It was found that the court report- 
ing occupation had none of the tra- • 
ditionally stereotyped characteris- 
tics of a female occupation yet was 
becoming female dominated. Court 
reporting paid well, carried prestige. 
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work variet)/, and leadership poten- 
tial. Court reporting had no prerequi- 
sites or skills that were sex linked. 
In fact, in July. 1976, the National 
Shorthand Reporters Association 
announced the 12 new fellows of the 
Academy of Professional Repprters, 
Eleven were men. In the 1977 Steno- 
graph contest, all eight winners were 
men. All articles concerning descrip-, 
tions of court reporting activities 
werevwritten by men.^ 

Vetr court reporting professionals 
and educator^ reported a shortage 
of [T}ales and at least a 70 percent 
female domination m classes. The 
possibility of a classical example of 
"reverse" sex stereotyping provided 
an opportunity to look deeper into 
this phenomenon of stereotyping 
and to look at stereotyping from the 
male point of view 

METHOD 

Projact Dasign . . 

In accamplishing the overall objec- 
tive through thp ex post facto re- 
search method, several questions 
i became pertinent that resulted in a 
project de;5ign w;th two thrusts. The 
first thrust, data collection, prompted 
these questions ^ 

1 What IS the sex ratio of students 
participating irt court repqrter edu- 
cation m NSRA-approved schools 
in Illinois? 

2 Has there been a shift from male 
domination to female domination in 
court reporting training programs, in 
lllinofs in the past 10-15 year^"? 

3. Does the sex ratio of Question 1 
and shift in question 2 correlate with 
the sex ratio of students in o^her 
related programs of study*^ 

*. The second thrust, conterjt anal- 
ysis, prompted these questions 

4 What elements of sex stereotyp- 
ing are found In recruitment ma- 
terial and curriculum descriptions 
used by NSRA-approved court re- 
porting schools? 

5 What other influences can be 
found that might explain the shift 

Er|c 



in sex ratio in the court reporting 
programs in Illinois? 

Population 

Illinois has five of the approximately 
70 nationally approved court report- 
ing training programs distributed 
throughout the country. Three of the 
schools are located in the Chicago 
metropolitan area, one is located in 
the rpid-state area, and one is a 
unf'J'ersity-based program in south- 
ern Illinois. Two of the schools are 
jurnior colleges, two are business 
colleges, and one is part of a voca- 
tional school of a university. Two 
schools have been in operation for 
more than 15 years, two from JO-15 
years, and one formless than Tour 
years Three are private schools am 
two are public institutions. Conse- 
quently, these five schools offered 
"a diversified population base to 
study. 

Since the court-reporting student 
population in these schools was 
generally small, it was decided to 
study the entire population of stu- 
dents and make ratio comparisons 
from 1966 to 1977 Also, since only 
five institutions were being studied, 
it was decided to review all recruit- 
ment materials and curriculum de- 
scriptions pertaining to the court 
reporting programs in these schools 
in the content analysis thrust 

instrumentation 

A sex-role stereotyping evaluation 
tool was developed by the project 
staff by analyzing similar tools used 
in other federal and state studies and 
by revismg and adopting segments 
of these tools for use in this study. 
The sex-role stereotyping tool was 
field tested and revised for use by 
the project advisory board in evalu- 
ating the cecruitment matenals, prac- 
tices, and curriculum descriptipns 
in the populal4bn studied. • 

Treatment of Data ^ 

The informatipn from the sex-role 
stereotyping evaluation tool as com- 
pleted by the advisory board mem- 



bers m evaluating the school ma- 
terials was coded for computer 
analysis, it was possible to analyze 
the evaluation in the following ways 
1 Item analysis of each stereotyping 
element including the absolute fre- 
quency of occurrence, adjusted fre- 
quency, and cumulative frequency 

2. Item analysis including the mean 
score for each piece of material 
evaluated. 

3. Composite mean scores of each 
Item according to the school from 
which the material originated. 

4. Composite mean scores of each 
Item according to the role of tfie 
evaluator, i.e., administrator, teacher, 
c^rt reporter. 

ANALYSIS AND DISCUSSION 
QF DATA 

S6X Ratios 

The initial research question was 
What was the sex ratio of students 
participating in NSRA-approved court 
reporter training programs in Illinois'^ 
Although the figures for male enroll- 



m©**t changed quite radically over 
the 12-year period, it can be seen 
when percentages are computed 
based on-the total number of appli- 
cants that tltere was a steady decline 
of males applying for certification 
over the year with a more extreme 
drop the last three years. The females 
achieving official certification domi- 
nated with the males showing a 
gradual decline by percent of the 
total population of those being cer- 
tified after 1971, particularly the last 
three years. 

Although females dominate m the 
ratio of those achieving the Certified 
Shorthand Reporter rating through 
the Illinois Office of Registration and 
Education, the figures prior to 1971 
are closer to equalization. The same 
drop in males can be noted since 
1975 (see Figure 3). 

It can be seen that there is no 
appreciable difference in the sex 
ratio or percent of male participation 
in the two l^orms of certification in 
Illinois Females radically outnum- 
ber males m. certification whether 



FIGURE 1 

Percent of Males Applying for Certification 
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FIGURE 2 

Percent of Males Achieving Official Certification 
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FlpURE 3 

Percentfof Males Achieving Certified Shorthand Reporter Certification 
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it be^ official certification through' 
the Administrative. Office of Illinois 
Courts or the Certitied Shorthand 
Reporter .certification through the^, 
Illinois Office of Registration andn 
Education. « 

The second research questiorr was 
whetberr^ or not a shift in. sex ratio 
could be determined. It was not pos- 
sible *to empirically establish a sex 
ratio shift due to the lack of public 
records prior to 1966. Merely per- 



sonal recollections of various court 
reporters and school staff at court 
^reporting schools in operation for 
over 30»years attest to the nearly 
75-80* percent rhale domination of 
the court reporting*programs In the 
l940's and 50' s. Consequently, t+iis 
study is only able to report a rela- 
tively steady decline in male percent 
of student population over the last 
12 years with a dramatic drop in the 
last three years.* 
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Content Analysis 

The content analysis research ques- 
tion was: Are there sex-role stereo- 
typing elements in the recruitment 
materials and curriculum descrip- 
tioas used by the court reporting 
schools that may deter males from 
participation m the program? 

A thorough review of pertinent 
literature provided many examples 
"of language evaluation tools used 
in studies to evaluate education ma-'' 
tenals. particularly useful were the 
Women on Wordj;- and Images study 
(1972). the Elhs'^study (1977), the 
Awareness Project, Feminists North- 
west (1976), and the Maher study 
(1976) Segments of these evaluation 
tools were revised and adopted for 
use in this study A segnr>eQ^ for use 
in evaluating illustrations was de- 
veloped by the project staff and pre- 
pared .for use by the advisory board 
in evaluating the school materials 
Orientation and validation The board 
was given an orientation into aware- 
ness of sex-role stereotyping in our 
society followed by a more special- 
ized presentation of how s^ex-role 
stereotyping is manifested, In educa- 
tion materials Following this presen- 
tation, the board was administered 
an evaluator's quiz validate the 
board's expertise in evaluating edu- 
cational materials for sex-role ste- 
reotyping. Out of 15 questions, 
most evaluators mrssed fewer than 
two with an overall ^erage error of 
15 percent per evaluator. 
Evaluation pf materials. The board 
was supplied with copies of all the 
recruit/tient material and curricu- 
lum ^descriptions from participating 
sc)^ools These materials included 
segments of college catalogs, spe- 
cially prepared brochures, and new 
Advertisements from local papers, 
a Language Although computation 
of the evaluators" scoring indi- 
cated some occurrence of nearly 
all of the stereotyping elements, 
the following elements received 
the most significant scoring In the 
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language section, the reference 
to secretarial skills as a prereq- 
uisite to court reporting was 
scored in the majority level. In 
other words, out of all the cases 
where this element could appear, 
It was present 51-75 percent of 
the time. Similarly, the reference 
to court reporting as part of a sec- 
retariakprogram was scored m 
the majoiH^ level Although the 
remainder of'the language ele- 
ments did not receive such sig- 
nificant scoring, the overall lan- 
guage score indicated that the 
language in the school materials 
was stereotyped enough in these 
two Items to pull down the overall 
language score considerably. The 
overall language score indicates 
that nearly 60 percent of the scores 
fell in the 25-100 percent fre- 
quency categories, 
b. Illustrations The single element 
that resulted in the most dramatic 
statistics in the illustration sec- 
tion was female subjects. Other 
elements resulted m high fre- 
quencies such as females in lead- 
ership or authoritarian roles and 
females who suggest all Ameri- 
can girl ' qualities. However, these 
percentages hardly approached 
the 67.6 percent majority fre- 
*quency of the female subjects 
Item. 

This overall, illustration score indi- 
cates that 70 percent of the scores 
fell in the 25-100 percent frequency 
categories In spite of the fact that 
the frequency levels m all the illus- 
tration elements except female sub^ 
jects were less than 30 percent, the" 
evaluators rated illustration sfegments 
with a high frequency of stereotyping 
— 70.3 percent. 

The analysis of the language and 
illustrations found in the court re- 
porting recruitment materials and 
curriculum descriptions indicated 
that many of these stereotyping ele- 
ments exist in the materials evaluated. 
The overall language and illustration 
scores indicate that materials exhtbit- 
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Ing the elements discussed above 
resulted in an extremely critical over- 
all score of the material. 
Other influences. The advisory board 
discussed what other possible influ- 
ences might be deterring males from 
court reporting education. The 11 
influences the board deemed impor- 
tant and a summary of their recom- 
mended solutions follow. 

1. Career Decision Practices 

Court reporting is seldom men- 
tioned or promoted in a career day 
setting Many students have already 
made career decisions before learn- 
ing about the court reporting occu- 
pation Court reporting needs to be 
included on interest inventories 

2. Self Employment 

Court reporting permits a person 
tp be self-employed, thus appealing 
to self-motivated people and people 
who do not object to working alone 

3. Image and Attitude 

Court reporting is often promoted 
as a career foiVpeople with the highest 
skills in typing and shorthand Actu- 
ally, these skills are not a py^requi- 
site to being a successful court re- 
porter Typing is a necessary skill 
only if the reporter plans to transcribe 
his own notes. 

4 More Women in Work Force 

As the number of women in the 
work force increases, there will natu- 
rally be more women in court report- 
ing education This is particularly true 
in cases where, the reporter desires 
good paying, part-time work 

5 Recruitment Practices jn High 
School ' ' 
Recruitment shoOtd be done in 

groups of boys and girls rather than 
just secretarial classes Also, males 
can be role .models for young men by 
recruiting personally. 

6. Job Security 

Court repJorting, as a form of self- 
employment, offers certain risks. Men 
with families may seek more stable 
employment with a set pay scale. 

7. Skill Requirements 

Since the majority of reporters 



prefer to transcribe their own notes, 
typing is a desirable skill. Yet. typing 
IS viewed ds a feminine sj<iH. 

8. Curriculum 

Most court reporting schools 
couch court reporting in their sec- 
retarial program Court reporting 
would fare better with males if it 
were part of the management elec- 
tives or data processing electives. 

9. "Shorthand" 

The word "shorthand" carries with 
It a negative female stereotype. 

10. Secretarial Alternatives 
Women may be more attracted 

to court reporting because, should 
they fail to achieve competency in 
this area, they have a socially accep- 
table alternative to fall back on m 
which they can use the skills they 
have mastered — secretarial work. 
Men. however, would hesitate to 
choose to become a secretary as an 
alternative; they would need to 
choose a completely different ca-. 
reer if they failed to achieve mastery 
of court reporting skills 
1 1 Reaching the Male Audience 

The board noted that many males 
learn>of court reporting as a career 
option through^amily or friends who 
either are court reporters, lawyers, 
or judges Recruiiment through the 
schools needs to be improved to see 
that males are informed of this career 
Qption before making career choices. 

SUMMARY AND CONCLUSIONS 

The project investigation can be sum- 
marized into the following two in- 
quiries: '(1) Does the sex ratio of 
court reporting students in NSRA- 
approved schools in Illinois over the 
past 12 years indicate an extreme 
relationship or shift m domination to 
a degree that warrants further inves- 
tigation'? and (2) Do -the recruitment 
materiials, curriculum descriptions, 
or other possible influences promote 
the uneven ratios or shift in ratios? 

The statistical data collected from 
,the Administrative Office of Illinois 
Courts in Chicago and the Illinois 
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Office of Registration and Education 
in Springfield show a decided female 
domination in court reporting appli- 
cation and certification. Applications 
from males for certification have 
dropped considerably in the last 
three years to as low as 3 percent of 
the total applications for certification 
in 1977. Official records were not 
available for the years prior to 1966. 
so an empirical statement of sex-ratio 
shift from male domination to female 
domination is not possible. However, 
It IS evident that the male popula- 
tion of trained x:ourt reporters has 
diminished steadily over the last 12 
years with a dramatic drop since 1975 
This sex-ratio difference and recent 
extreme increase in female domina- 
tion warranted further investigation 
A review of the recruitment mate- 
rials and cllfnculum descriptions of 
the selected Illinois NSRA-approved 
schooFs was conducted by the project 
advisory board The board, made up 
of court reporting school administra- 
tors, court reporting educators, and 
professional court reporters, found 
many instances of female sex-role 
stereotyping in both language and 
illustrations. The most blatant exam- 
ples include reference to secretarial 
skills as a prerequisite to court report- 
ing, court reporting as a part of a 
secretarial department or program, 
and the use of female subjects in 
illustrations. Sex-role stereotyping 
was not found to exist at a higher 
level in any one school nor did any 
particular roLe of advisory board 
member (administrator, educator, 
reporter) evaluate the material to any 
appreciable difference 

The board analyzed 11 other pos- 
sible influences on the sex ratio m 
court reporting schools. Nine of the 
eleven influences were directly re- 
lated to recruitment procedures com- 
pletely apart from the actual recruit- 
ment materials. Some of the most 
emphasized were the secretarial 
image, recruiting m predominately 
female settings (shorthand classes), 
couching court reporting in the sec- 



retarial program, and failing to recruit 
in male audiences In other words, 
court reporting schools are training 
the very people they recruit — fe- 
males. 

REFERENCE NOTE^ 

1, Peppey, R. Personal communication. 
February, 1978. 

2 Glassbrenner, M Personal communica- 
tion, February. 1978. 

3 Palmer, C Personal communication, 
February, 1978 
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RESEARCH PROCEDURES 

Research design affects the validity, objectivity and accuracy of the 
answers to research questions. Situations involving human beings 
going about complex behaviors such as education do not readily lend 
themselves to, rigorous controls, consequently, research design must 
be adjusted to accommodate the realities of the situation so that the 
degree of confidence in the findings is not undermined. At the present 
time the research effort relative to sex equity in vocational education 
could be strengthened by the use of more robust research designs. 

This writer is willing to concede that the perception of apparent 
design inadequacies in studies reviewed may result from omission in 
reporting rather than in actual procedures used. For example, when 
studies do not report the number of persons involved, or give only a 
number of participants^ without indicating how their involvement was 
obtained or what they represent, it is difficult to accept the rest of the 
study with any degree of confidence. SiT^HUocj^iriissions in areas other 
than sampling were observed. In the future, authors would be advised 
to report design aspects of their studies in sufficient detail so that 
others may make reasoned judgments about the findings. 

Rtfttrch Disign 

The research design most commonly used to examine sex equity in 
vocational education is the one-shot case study. The shortcomings 
of this (design are well documented (Campbell & Stanley, 1963). As 
noted earlier in this review, there are those studies which use other 
designs. The one-group pretest/posttest was used by Griffin (1978) 
and Willis and Hopson (1979). Walters (1976) used a Solomon 4-group 
design in her study. 

While the one-shot case study has limitations as a research design, 
it can be used to provide the kind of data base necessary to determine 
the status of selected variables and to explore other researchable 
problems, particularly in the realm of action research. Vocational 
educators needed baseline data and within a short time frame. As the 
time press becomes less severe It is hoped that research designs 
used will beimproved and earlierstudies replicated with more precision. 

Sampling 

All three of the example studies in this section used a state-base for 
their population. Dittman used a stratified random sample selection 
procedure to ensure representation from all program areas, while 
Moyer lased a similar procedure to obtain subjects of both sexes. In 
both cases these researchers had the advantage of a known accessible 
population. In fact, Moyer had data from the entire population — a 
luxury noj available to many researchers. Anderson and Stitt used all 
programs within their state to provide a sample which they justify as 
representative of the national population of court reporting programs. 

Two studies which offer exemplary complex sampling procedures 
are Kane, Frazee and Dee (1976) and Atkinson (1978). Kane et al. 
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used a national sample and sophisticated procedures to ensure 
representation m both the sarnple of nontraditional students and con- 
trol sample. The Atkinson study involved a state-based population 
with the need to include several strata, however, as she notes (p. 2) 
the nomination process may place the randomness in question. 

With such exceptions as those noted above, a review of the sampling 
procedures used indicates non-probability samples are the norm In 
most cases the sample size was adequate for complex statistical 
analysis, even if such pro^iedures were not used. 

Mithods of Data Collection 

The most frequent methods of data collection were the use of a ques- 
tionnaire or interview or some combination of the two. The Dittman 
and Moyer studies both involved questionnaires. 

Most of the studies reviewed used instruments developed specifi- 
cally for the study in question. Regrettably, little or no data are pro- 
vided by most authors on the establishment of reliability and validity 
for these new measures. There are promising beginnings, for example 
Sexism Awareness Instrument (Griffin, 1978) and Attitudes Toward 
Women Scale (Walters, 1976). Exceptions to the use of new measures 
were Dittman (1976>, Eversole (1977) and Griffin (1978) utilizing the 
Bem Sex Role Inventory (Bem, 1974, in press) and Walters' (1976) use 
of Rokeach Dogmatism Scale (Rokeach, 1960). 

Those studies using printed nfaterials as cases to be analyzed and/or 
evaluated, mcluding the Anderson and Stitt study developed criteria 
and codes for this procedure. In many instances such analysis requires 
no evaluation on the part of the reviewer — a pronoun is either male or 
female or neuter. In those studies where judgment is called for, re- 
searchers would be advised to r^^ort procedures for determining inter- 
rater reliability. 

SUGGESTIONS FOR FURTHER RESEARCH 

Research in the area of sex equity in vocational education is a rela- 
tively new endeavor. The findings from the effort to date plus the 
findings of related studied suggest further research is warranted. 

One problem to be unravelled is the relation between sex affirma- 
tiveness and sex equity and whether sex affirmative effort alone meets 
the stated requirement of sex equity. This suggests that there is a need 
to examine what the result would be if programs presently offered to 
females alerting them to a broad variety of vocational options were 
offered to males simultaneously. Smith (1977) gives us a hint about 
the probable results, but this effort bears replication in other settings 
and with postsecondary populations. 

An area of research needing attention is that of instrument develop- 
ment and validation. As noted above, there are good beginnings par- 
ticularly of attitude scales and interview schedules. While these can 
profit from further development, they do not exhaust the possible 
mables or approaches. There is a need for precise observation sched- 
uled^) to d^fefmine if there are discernable differences in behavior 
towaTd-students as a result of differences in sex equity of attitudes 
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We know that many vocational personnel hold views that are less 
than equitable with respect to males and females. To what extent are ^ 
these views more or less biased than other educators or administrators 
or students? Assuming that attitudinal differences result in behavibral 
differences, effort directed toward change will need to be continued 
to determine an effective means of achieving sex equitable behavior. 
Change efforts, with appropriate research design parameters to deter- 
mine the effect of a given treatment, need to be determined for both 
sexes — students, parents, teachers, administrators and employers. 

Apparently little, has been done in many program areas of vocational 
education to determine the extent of sex bias and sex stereotyping in 
educational materials. This is a need to be explored further, but per- 
haps a more important issue is the impact of sex fair and sex biased 
materials upon learners. 

These suggestions are by no means exhaustive of the areas of 
needed research. Indeed they barely scratch the surface. They are 
representative sac»f5ies in an area in which there is great potential and 
great need for further study. 

A FINAL COMMENT 

Both males and females ex+iibit sex stereotyped or sex biased views 
and behaviors, and both males and females are victims of such views 
and behaviors. However, the majority of the researchers and personnel 
working in vocational education in the area of sex equity are female. 
Indeed the products of efforts to date — curricula, educational ma- 
terials, programs designed to create awareness of the problem, etc. 
— by and large reflect impetus and concern by and about females. 
In the area of research this trend persists. The intent of noting this is 
to alert ourselves to the possibility of unintended consequences — 
self-fulfilling prophecies being one. If the goal is sex equity, both 
sexes need to be involved as investigators and subjects to maximize 
the likelihood of success and to provide data which permit realistic 
comparisons of the situations of males and females in vocational 
education. Consequently, this writer concludes, as did Parlee (1975) 
in a review of research in another area of study, that at the present 
point in time it is as important to know who are the investigators and 
what are the questions they have not asked as it is to know what are 
the findings. 
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INTRODUCTION 

The task of summarizmg and synthesizing curriculum and instructional 
research is indeed ominous. Everi when this task is delimited to voca- 
tional education, one pan easily view the end product as reaching 
encylopedic proportions. The sheer magnitude of vocational curricu- 
lum and instructional efforts makes sifting processes most difficult. 

This section serves to describe several trends in vocational educa- 
tion curriculum and instructional research. By virtue of spate limita- 
tions, the discussion does not treat this research area in an exhaustive 
fashion. It is instead drawn from numerous studies in the field which 
reflect the general state of the scene. Initially, consideration is given 
to research efforts in the more distant past This is'followed by a 
Summary of studies which have critically examined the quantity and 
quality of past vocational education curriculum and instructional 
research efforts. Next is provided a review of vocational curriculum 
and instructional research which tends to focus on topical areas and 
should reveal meaningful trends. Finally, several conclusions are 
drawn which provide an agenda for future research. 

THE PAST AS PROLOGUE 

Our past IS rich with documents which, in many respects, foretell the 
present and the future of vocational curriculum and instructional 
research. Perhaps the modern day "classics" in this regard are review 
and synthesis publications produced by the American Educational 
Research Association and the ERIC Clearinghouse on Vocational and 
Technical Education, The Ohio State University. These seminal works 
provide a foundational perspective and a direction for present and 
future research. 

A particularly noteworthy review edited by Moss (1968) contains 
chapters focusing on curriculum development (Phipps & Evans, 1968) 
and techniques and modes of instruction (Householder. 1968) Phipps 
and Evans commented that curriculum research at that timeemphasized 
(a) the jdenlification of content common to clusters of occupations and to all 
kinds of work, (b) the development of curriculums for students with special 
needs, (c) the adaptation of curricuiums to changes in educational approaches 
and technology, (d) the identification of auriculum changes required by lech 
nological developments, and (e) attention tq occupational areas that were 
previously overlooked or considered unworthy 

They went on to indicate that investigators must be increasingly crea- 
tive in terms ,of design and statistical analysis due to the complexity 
of curriculum development research problems. While Householder 
ackapwledged that studies reviewed in his chapter represented an 
encouraging start, he stated that research .efforts had "not yet made 
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Significant contributions toward the establishnnent of a body of knowl- 
edge on techniques and modes of instruction." 

More recent review ^nd synthesis have tended to be specific in focuS 
and comprehensive in nature. Representative are reviews dealing with 
analysis for curriculum development (Larson, 1969), occupational 
adaptability (Sjogren, 1971). individualizing instruction (Impellitteri & 
Finch. 1971). and strategies for effecting change (Wall. 1972). These 
papers note the ne.cessity for more systematic investigations which 
contribute to a meaningful body of knowlege. Impellitteri and Finch 
(1971), for example, cite the need for more programmatic research 
and development w^hich focuses on areas that are of widespread con- 
cern. In sum. research conducted during the 1960's and earlvJ970's 
has tended to be overly simplistic and problematic in nattfre. Few 

substantive, programmatic research efforts have been carried out. 
• * 

THE PRESENT MIRRORS THE PAST 

It was during the mid 1970s that several groups external to vocational 
education began to study what vocational education research had 
accomplished and the benefits that had accrued. These studies, con- 
ducted by groups such as the Ran^ Corporation. National Academy 
of Sciences. General Accounting Office, and Development Associates, 
sought to evaluate the payoff associated with vocational education 
research and development (Moore & Magisos, 1977). The Committee 
on VocatiOJial Education Research and Development (COVE RD) which 
focused most directly on research, exemplary programs, and curricu- 
lum development efforts (National Academy of Sciences, 1976). pie- 
pared a most comprehensive report which is well worth the time to 
review. Provided as an appendix to their report is a review of vocational 
education R and D in major priority areas. Comments, emerging from 
the section on instructional techniques reflect the need for more sys- 
tematic research efforts. The report noted that "there has been only, 
limited use of experimentation, and research methodology has often 
. "^^been ineffective." Research in the area of curriculum developmqnt 
wal, likewise, cited as being open to question. While COVERD noted 
that persons present at hearings mentioned curriculum projects more 
frequently than any other vocational education R and D effort as 
having impact on the field, research results did not support this notion 
AppacentLy. the bpdy of knowledge which serves as a base for voca- 
tional courses has not been fully explicated. 

Perhaps of foremost concern to COVERD was the failure of voca- 
tional educaticfh R and D to deal "with significant issues and for not 
providing evidence of impact on ^Students" (Moorfe & Magisos. 1977) 
W^^lle CQVERD has been criticized for placing" heavy reliance on the 
quality of secondary ex post facto data in the report development 
process, curnculum and instructional researchers should note that 
data were, for the most part, generated by persons within vocational 
education. 

In sum. the present appears to correspond with results from the past. 
While research dollars have been available and studies have been 
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completed, activities have tended to be limited in generalizability and 
have lacked the ngor associated with sound research methodology. 
Although the number of vocational edlication programs and students 
has increased dramatically, there does -not appear to be an overall 
plan "or seb of plans to ensure thdt curriculum and instructional re- 
search ultimately contributes to the quality of vocational education. 

STRANDS OF A RESEARCH FABRI&. 

In spite of the criticisms leveled a^ vocational education curriculum 
and ir^structional research, there is certainly some light ^t the end of 
the tunnel. That which follows vvill serve to ppint up some of the more 
meaningful trends in currfculum and instructional research and, hope- 
fully, provjde some idea of the pattern that research is following. In 
order for research to have meaningful impact on the field, it is«nece6- 
sary to consider the range of the possible research problems and focus 
on homogeneous segments W this universe until jeach' problem is elim- 
inated or at least reduced. Consider this as the fabric' of research with 
curriculum and instruction being fabiric segments. Strands are inter- 
related studies which hold the fabric together and allow us to clearly 
identify its character. Thus, in order to be meaningfuj, each study 

* jshould build upon a body of knowledge and seek to contribute mpre, 
knowledge about an area of study. 

This discussion focuses on studies having pqtential to be woven 
into a meaningful research fabric. Each study is merely illustrative of 
research conducted in vocational educajtion curriculum and instruc- 
tion. Others will most, certainly emerge as being of eq^jal value and 
utility. The ways that studies are arranged reflect trends or potential 
•^trends in the conduct of research. These arrangements include the 

- *study of curriculum content, instructional strategies, implementation, 
articulation, and curriculum professionals. 

Curriculum Consent \ 

While the identification of meaningful curriculum content has pragued 
vocational educators for many years, recent research efforts have 
.attempted to overcome or at least seek anStwers to this problem. Finch 
and Crunkilton (1979) note that there are at least six strategies for de- 
riving vocational curriculum content, philosophical base, introspec- 

^ tion. funcfioh approagh. task analysis, critical incident technique, and 
the Delphi ^pproach^One ot. these, task analysis, has proven quite 
useJul to the Vocation ahTecl\mcai. Education Consortium of States 

^ (V-TECS).'V-TECS, which was chartered in 1973 to produce valid, up- 
to-date lists (catalogs) of occupational competencies, presently in- 
cludes some,17tetates, as welt as the U.S. Army, Navy,, and Air Force 
It is perhap^^the* most massive consortium effort aimed at developing 
worker verified curriculum content. A similar thrust is being carried 
out through the Interstate Distributive Education Curriculum Consor- 
tium (IDECC). This consortium was establlfeied in the- early 1970's to 
develop a competency-based learning system in distributive educa- 
tion. Cpnsortium*activities include occupational task research, com- 

. patency identifications and clustering, and leai^ning activity package 

' development. ^ • ^ , 

ERIC . ' ' ^ 6\j 

■ / 



Botrt V-TECS and IDECC have sought to meet the increased demand 
for competency based vocational education (CBVE) content and ma- 
terials (Knaak, 1977) CBVE has emerged as a major curricular move- 
ment in vocational education and, as such, demands continued re- 
search to answer relevant questions and fiJI knowledge voids. Work - 
conducted in Indiana serves to exemplify the activities carried on by 
several states. Reports by West (1978) and Brannock (1978) document 
a research sub-system which 'serves to strengthen the link between 
education and work through CBVE. 

Some of the more exciting research dealing with curriculum con- 
tent is being conducted at The National Center for Research m Voca- 
tional Education, The Ohio State University. The focus of this research 
has been occupational adaptability and transferable skills. A report 
by Pratzner (1978) presents many of the substantive issues which arose 
during project activities. Also included are several examples of trans- 
ferable skills and characteristics Other reports produced 'as part of 
the project deal with areas such as the employer's viewpoint of trans- 
ferable skills (Wiant, 1977), a task classification approach for identify- 
ing transferable skills (Ashley & Ammerman, 1977), and teaching for 
transfeF^eiz & Ashley, 1978). Collectively, these reports provide a 
most meaningful research base for planning and establishing voca- 
tional curricula. ^ 

Concern about non-technical curriculum content (e.g., work values 
and attitudes) has given rise to research in this important area. Due to 
the natut'e of non-technical content, researchers have tended to move 
away from the more traditional data gathering approaches in an effort 
to capture th^ elusive affective components of work. Corbin's (1976) 
. study of goals for the Distributive Education Clubs of America points 
up the applicability ot the DelpHi technique to a content area which 
has no tie with an external standard (e.g., worker behavior). His results 
' support the notion that the Delphi technique has utility for determining 
meaningful affective content in a range of areas. Research conducted 
by O'Ne'il and N^son (1976) was concerned with the identification 
and applicability of occupational survival skills. Their investigation 
served as a basis for the development of meaningful curriculum 
materials. 

A study completed by Foster (1978) sefved to verify the usefulness 
of the critical incident technique as a means of identifying non-tech- 
nical affective skills. Data of the sort gathered in Foster's study would 
serve as a reasonably objective base for anective portions of vocational 
curriculum content Beach (1979) reported the conduct of a study de- 
signed to identify affective work competencies. As part of the investi- 
-gation, an Affective Work Competencies Inventory was developed ^ 
which has provided informatiori about t*he ways affective compe- 
tencies vary across groups. 

Instructional Strategies 

Impellitteri and Finch (1971) noted that most vocational education 
learning studies had been overly simplistic in design and had failed 
to utijiie clearly defined variables. While these deficiencies generally 
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continue to exist, several researchers have seemingly broken out of 
the traditional mode and conducted studies which address the-^'com- 
plex learning processes associated vvith vocational education Studies 
cited below serve to remind us that a range of research possibilities 
exist with regard to instruction and learning. ^ * 

A recent study by Buffer and Miller (1978) exannined the effects of 
selected industrial arts activities on educable mentally retarded stu- 
derits achievement and retention of metric linear concepts. It is ap- 
parent that significant findings might have been lost if the researchers 
had not chosen to employ an experimental design with multivariate 
analysis of va/iance (MANOVA). Stewart, Lash, and Kazanas (1976) 
focused their research on the influence of reading ability and verbal 
. modality and principle learning on vocational students. They, likewise, 
chose to randomize subjects and utilize MANOVA. Others should 
carefully consider following these examples as instructional research 
studies are being designed. ^ 

An area closely aligned with instruction is the measurement of learn- 
ing Olson (1978) reported the design and validation of a straight-copy 
typewriting prognostic test using kinesthetic sensitivity. A study con- 
ducted by Keith (1978) focused on the development of an instrument 
' to evaluate problem-solving' skills of secretarial students. It is only 
through the development of applied measures such as these that mean- 
ingful instructional outcomes may be>assessed. 

The demand for more relevant instruction has resulted in a greater 
emphasis on individualization of vocational instruction And. while 
many have supported this concept, few have chosen to operationalize 
It to the point wh^re individualization may be carried out in realistic 
learning settings One such application is reported by Faust (1978) 
The New Hampshire project on alternative approaches to individualiza- 
tion in vocational education presents instructors with alternative 
implementation models, thus allowing for flexibility of installation. 
OthQr states would do'well to follow this lead if jtheir intention is to 
provide vocational students with indivi^dualized programs 

Implementation 

The success of any curriculum or instructional innovation is, in large 
part ,^ affected by user acceptance and acBption Thus, the diffusion 
"'of research and development prbducts becomes equally as important 
as the products which are produced. Hull (1977) indicates several con- 
ditions wfiich currently inhibit the diffusion of vocational education 
R and D. These include the lack of meaningful diffusion linkages and 
fragmented dissemination of R^and D outputs. He goes on to npte that 
the diffusion of vocational education R and D "must be based upon a 
sound technology, one which has' been validated by research and 
development/' * 

Several studies have sought to build a rinore v&lid base for the diffu- 
sion process. Russ^ell's (1972) investigation which focused on the 
I development of an instrument to measure change orientation of voca- 
tional education teachers has served as an instrumentation base for 
numerous studies in the field. Among these are studies conducted 
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by H006 (1975) which focused on home economics teachers and 
Ditzenberger (1978) which dealt with perceived barrier^ to implement- 
ing a distributive education learning system. A related study by 
Oscarson (1977) examined personal characteristics as a means of 
identifying adoption-proneness among vocational teachers. 

Research conducted by Page (1976) examined the impact of two 
types of innovations upon educational administrators. The innova- 
tions consisted of vocational education training materials and infor- 
mation documents. Results of the Page study have several implications 
for carrying out diffusion activities, particularly as related to printed 
materials and documents. 

Articulation ^ 



Over the past several years, a great deal of concern has been ex- 
pressed about the articulation of vocational content between secon- 
' dary and post-secondary^ institutions. In response to this concern, a 
federally funded articulation study was carried out as a joint venture 
of the American Vocational Association and the American ^Associa- 
tion of Community and Junior Colleges (Bushnell, 1978). This study is 
one of the 'first steps in a long-range effort which must be undertaken to 
devise meaninglul articulation systems for vocational education. It 
incfudes case studies in articulation as well as recommendations for 
change to achieve eff^ective coordination and cooperation in voca- 
tional education. 

Several states have followed suit by carrying out studies focusing 
^ on their unique'articulation problems and iieeds. In New York, levels 
of planning and coordinating articulated programs were identified 
'as well as factors which encoutage and factors which prevent articu- 
lation (Whalen, Powman & Van Orman, 1979). Wisconsin developed a 
model for articulation which is detailed in a comprehensive implemen- 
tation manual (Spanbauer & Nagy, 1977). Efforts in New Hampshire 
^ have focused on establisbjng a model process for curriculum articu- 
lation involving secondary and post-secondary occupational instruc- 
tors (Faust, 1977). 

Work being carried out in these states is representative of articu- 
lation planning going on .across the nation. It appears that, in time, 
* more systematic articulation processes will emerge. Tlje large njjmber 
of studies being conducteil in this area at least ensures th'at a broad 
range of possible articulation processes will be examined and docu- 
mented , 

Currhculum Professionals 

The notion that person;5 should be prepared to deal specifically with 
vocational education curriculum development has sparked an interest 
in determining what activities these professionals should perform. 
One such study carried qut by Wiant (1976) focused on the activities 
and «needs of persons engaged'in vocational education curriculunil 
development in public education, business and industry, and govern- 
ment For the respondent group taken as a whole, the most critical 
activities were found in the categories of curriculum management 
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and administration, content selection and organization, and evalua- 
tion Somewhat similar studies were carried out by Washington State 
University (WSU) and American Institutes for Research (AIR) (Bakamis 
& McPherson. 1976), Data collection from the WSU and AIR instruments 
served as a basis for designing a competency-based graduate program 
for vocational education curriculum specialists. Module^ developed 
as a^part of these federally funded projects are currently fcemg refined 
and tested on a national basis by American Institutes tor Research 
(Jung. Hefliwell & Hamilton, 1979). Hopefully, this work will provide 
a more definitive basis for the preparation of vocational curriculum 
professionals. 
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Career Maintenance and Mobility Factors — 
Occupational Survival Skills 



SHARON LUNID O^NEIL 
Board of Education 
New Milford, Connecticut 
ROBERT E. NELSON 
University of Illinois 
at Urbana-Champaign 

The recent advancements m Ameri- 
can technology have created a vari- 
ety of occupational complexities for 
the contemporary worker, As the 
world of work becomes more diver- 
sified, workers are faced with prob- 
lems related to )0b maintenance, 
career retraining and readjustment, 
upgrading of skills and occupational 
mobility, 

It IS not uncommon for persons m 
'the nation s work force to make sev- 
eral career changes during their work- 
ing years (Bolles, 1972). In fact. Venn 
(1971) has indicated that Jour or five 
occupational changes may occur dur- 
ing one's work life If this trend 
continues, most of society must be 
prepared to accept and adapt to occu- 
pational change 

Today, jOb openings exist for occu- 
pations which were not in existence 
a decade ago. As hew jobs are cre- 
ated, others become obsolete (Terkel. 
1974) and are no longer needed The 
accelerated rate of change In our so- 
ciety has resulted in fewer workers 
being able to look forward "to a life- 
time career in which the knowledge 
and skills which qualify them far a 
specific occupation in their yoJths 
will, serve t^roughout their worKing 
Jlfe" (Adam^ and Reagan. 1972, p 
160) ^ ^'^"^ ^^ ' 

In view of this, the ease with which 
workers can m^ke the transition from 
one job to another becomes increas- 



ingly important. Consequently, sur- 
vival in the world of work may be 
contingent upon possessing a com- 
mon core of skills to permit career 
changes without pursuing extensive 
retraining between occupations If 
these skills can be identified and 
infused into occupational prepara- 
tion programs, problems pertaining 
to worker survival may be reduced 
or even eliminated. 

The present research study was 
conducted to identify "occupational 
survival skills" — the basic knowl- 
edges, traits Snd competencies most 
appropriate for worker success in 
maintaining their occupations Occu- ^ 
pational survival skills may permit 
workers not only to successfully ^ 
maintain their chosen occupations, 
but also to move from occupation to 
occupation with a minimum of re- 
training. 

METHODOLOGY 

A tentative listing of over 500 occu- 
pationak'sCh^vival skills was identified 
through the following procedures an 
extensive review of related literature, 
interviews with a variety of workers, 
consultations with manpower per- 
sonnel, research authorities, voca- 
tional and technical research and 
development personnel ^t.the stajie 
level, vocational educators and othei'S. 
and input from numerous students. 
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university faculty and sta(f and otfie 
workers. 

Reduction of the list of occupations 
survival skill items began by combir 
ing and grouping Similar descriptors 
The resulting list and subsequent list 
were submitted to more than 30 
workers representing a wide diver 
sity of occupations Each person was 
asked to rate the items they consid- 
ered to be important for workers to 
possess for successful job main- 
tenance The 75 most frequently 
checked items were then submitted 
to each of eight members of a se- 
lected panel of education experts 
The 27 most frequently checked oc- . 
cupational survival skill statements 
remaining after eight successive rat- 
ings by the panel were included in 
the survey instrument These state- 
ments appeared to be representative? 
of the following areas' (a) interper- 
sonal relations and communicationSj 

(b) personal charactenstibs, (c) deci- 
sion making and problem solving, 
and (d) job characteristics, health 
and safety 

As a measure of test-retest reliabil- 
ity, a phi coefficient was calculated 
from the panel's first and second rat- 
ings of the Items The phi coefficients 
ranged between 41 and 63 

A telephone survey instrument was 
developed which contained 41 items" 
— the 27 occupational survival skill 
statements 'to be rated by respon- 
dents as to importance m keeping 
their jobs, three open-ended ques- 
tions concerning respondents' atti- 
tudes toward their jobs and 11 ques- 
tions relating to demographic data, 
A pilot test was conducted to (a) re- 
fine the survey instrument, (b) esti- 
mate the percentage of response and 

(c) identify objectives for interviewer 
training sessions Fifteen persons 
were trained to conduct the tele- 
phone suryey. 

A rancjom sample of workers repre- 
senting the general population of the 
Stafe of Illinois was selected from 
current telephone directories. Ran- 
dQm digit dialing was used in the 

'7 ^ 



Chicago area because approximately 
30 percent of persons with tele- 
phones have unlisted numbers (Slat- 
tery. 1975)". Within.a two-week period, 
589 workers were interviewed, They 
were grouped according to occupa- 
tions into the nine occupational clas- 
sifications used by the State of Illi- 
nois. Bureau of the Budget^ (1974) 
— an adaptation of the system of the 
U.S. Government. Department of 
Commerce, Bureau of the Census 
(1960). Frequencies and. standard 
scores were obtained, and discrimi- 
nant analysis was utilized in deter- 
miriing diff^ences of the variables 
wrthin and among the nme occupa- 
tional classifications 

DISCUSSION OF RESULTS 

A variety of information concerning 
the charactenstics of the study popu- 
lati'on was collected. Of the 589 re- 
spondents, 295 were female and 294 
were male. About 93 percent of the 
sample were employed at the time 
of the survey, Thirteen percent of the 
sample were self-employed Approxi- 
mately 40 percent of the respondents 
indicated that they^worked more than 
40 hours a week. 

The majority of respondents (74 
percent) had worked for the same 
organizatifi^n for 2 or more years, and 
44 percent of the organizations em- 
ploying the sample population had 
a work fofce of 101 or more persons 
Although 53 percent of the respon- 
dents had supervisory responsibili- 
ties, only 30 percent of the total 
sample were responsible for 6 or 
more persons. 

Over half of the sample population 
were between the ages of 26 and 50. 
30 percent we/e between the ages 
of 26 and 35: and 27 percent were 
between the ages of 36 and^ 50 Ninety 



^ Professional, Technical, Kindred. Man- 
agers, Officials. Proprietors\ Sales Work- 
ers, Clerical Workers, Craftsmen, Fore- 
men, Kindred. Operatives, Service Work- 
ers. Latx)rers. except Farm, and Farmers 
and Farm Workers . 
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percent of the respondents had at 
feast a high school education Twenty- 
'eight percent of the sample had a 
Bachelor's degree or had completed 
16 or more years of schooling. 

The 27 occupational survival skill 
Items were rated by the 589 respon- 
dents according to Very important 
(4). important (3). Somewhat Impor- 
tant (2). Not Important (1). and Does 
Not Apply (0). of which the last two 
categories were combined and scored 
as (1) after obtaining frequency infor- 
mation The rationale for combining 
these two categories was that when 
an item did not apply to a person's 
occupation, it was of no importahce 
to that person's job. The categories 
were separated on the survey instru- 
ment f6rm only because it was deter- 
mined in the pilot test that persons 
were able to relate better to the two 
. types of responses 

When the data were analyzed with 
the use of frequency distribution and 
standard scores program, it appeared 
that many similarities existed in the 
types of occupational survival skills 
needed by workers in the various 
occupational classifications. Table 
1 indicates the frequencies and per- 
centages for each of the 27 occupa- 
tional survival skill items for the total 
of 589 respondents in the study. ' 

In terms' of frequencies over 82 
percent of the 589 tota^respondents 
rated the skill to be dependable (X2), 
as Very Important in keeping their 
jobs The following 11 skills were 
rated as being Very Important for job 
maintenance by at least 50 percent 
of the total respondents These skills, 
along with, percent of response and 
" variable number, include: 
82 3% to be dependable (X2) 
61.6% to understand written in- 
formation (Xs) 
58 1% to follow instructions (X22) 
57.7% to get along with people 
with a variety of person- 
alities (Xa)- 
57.0% to give an honQSj, day"$^. 

work (X12) 
53 3% to manage time and ma- 
terials efficiently (X26) 

er|c 



53.0% to be punctual (Xi) 

52.0% to work without close su- 
pervision (X23) * 

51>1% to know what is expected 
of you (X16) 

50.3% to maintain good health 
(Xio) 

50.3% to know your own abilities. 

strengths, and weak- 
nesses (X11) 

Of the 27 occupational survival 
skills included rn the survey Instru- 
ment, organizing the work activities 
of other people (X5) was rated as the 
least important skill. Thirty-seven per- 
cent of the sample said this skil 
either was Not Important or D/d Not 
Apply to their jobs. Thirty percent of 
the respondents, however, maintained 
it was Very Important.^ 

A rank ordering of means for skills 
in each of the nine occupational clas- 
sifications is p/esented in Table 2. 
The skills are arranged in such a man- 
ner that a skill ranking higher than 
another skill must receive a higher 
mean in every occupational group 
than the lowest mean for a^iother skill 
in any occupational group. For ex- 
ample, the skill of being dependable 
(X2) has as its lowest mean for any 
one occupational group, 3.59 (Group 
8, Laborers, except Farm). This mean 
is higher than the lowest mean for 
any other skill in any one occupa- 
tional group. 

Before any conclusions based on 
means alone are'made concerning 
the skills needed by workers m all 
types of occupations, differences in 
occupational'survival skills among 
the nine occupational groups should 
be considered. DIsdriminant anal- 
ysis was utilized to statistically de- , 
termine which of the 27 skills con-' 



^ Note that the 27 skills on the aurvey mstru- 
^ment were selected from a preliminary list 
of over 500 items. Since the 27 items were 
selected to represent occupational survival 
skills that would be as broad as possible, 
it appears reasonable that most skills would 
be rated as at least Somewhat Important 
by persons in most types of occupations 



TABLE 1 

Total Responses for 27 Occupational Survival Skills 



Number and Percent of Total Respondents 



VERY SOMEWHAT NOT DOES 

IMPORTANT IMPORTANT IMPORTANT IMPORTANT NOT APPLY 
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Occupational Survival Skill 


No. 


% 


No. 


% 


No. 


% 


No. 


% 


No. 


% 




be punctual . 


312 


57 97 


159 


27.00 


65 


11.04 


28 


4 75 




4.24 


X2 


be dependable 


485 


82.34 


87 


14.77 


10 


1.70 


4 


.68 




.51 


X3 


get along with people with a variety of 
























personalities 


340 


57.72 


141 


23.94 


67 


11 38 


33 


5.60 


8 


1 36 


X4 


work as a team member 


291 


49.40 


157 


26.66 


^ 54 


9.17 


57 


9.68 


30 


5 09 


Xs 


Organize work activities of other people 


174 


29.54 


114 


19.36 


82 


13.92 


90 


'15.28 


129 


21.90 


Xe. 


understand written information 


363 


61.63 


143 


24 28 


34 


5.77 


31 


5.26 


18 


3.06- 


Xr 


have basic writing skills 


220 


37.35 


157 


26.66 


92 


15.62 


86 


14.60 


34 


5 77 


Xt 


have basic speaking skills 


252 


4278 


171 


29.03 


83 


14.09 


66 


-11.21 


17 


2.89 


X9 


be neat and clean in appearance 


267 


45.33 


154 


26 15 


80 


13 58 


65 


11 04 


23 


3 90 



Xfo maintain good health . . .296 50.25 

Xii know your own abilities, strengths and 

- weaknesses * 296 SO.26 

Xi2 >give an honest day's work 336 57.04 

Xn* be loyal to the organization for which you work 286 48.56 

Xi4 make independent decisions 248 42.10 

Xi5 use initiative and imagination 248 42.10 

Xi» know what is expected of you 301 51.10 

Xi7 have basic arithmetic skills . 254 43,13 

Xia know how to use )ob materials, machines 

or tools 282 47.88 

Xi9 locate information, materials or equipment 276 46.86 

X20 have some type of specialized training . , . 244 41 43 

X21 have a basic knowledge of your organization's 

operating procedures ... 239 40.58 

. X22 follow instructions .... 342 58.06 

X23 work without close supervision 306 51.95 

X24 work under tension or pressure . . . 287 48.73 

X2) adjust to various work situations 284 48 22 

X2» manage time and materials efficiently ... 314 53.31 

X27 follow safety regulations . 285 48 39 
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210 


35 65 


6f 


10.36 


215 


36.50 


53 


9 00 


198 


33 62 


37 


6 28 


168 


28.52 


77 


13.07 


199 


33 79 


64 


1087 


199 


33 79 


65 


11.04 


235 


39.90 


38 


6.45 


128 


21 73 


. 95 


16 13 


138 


23.43 


64 


10 87 


187 


3175 


55 


^.34 


159 


27.00 


70 


11.88 


190 


32 26 


76 


12.90 


183 


31.07 


28 


4 75 


180 


30.56 


34 


5.77 


153 


25 97 


57 


9 68 


207 


3514 


51 


8 66 


203 


34 46 


39 


6.62 


134 


22 75 


63 


10 69 



15 


2.55 


7 


1 19 


17 


2.89 


8 


1.36 


13 


2.21 


5 


.85 


34 


5 77 


24 


4.08 


55 


9 34 


23 


3.90 


54 


9 17 


23 


3.90 


10 


1 70 


5 


85 


79 


13 41 


33 


5 60 


56 


9 50 


49 


8.32 


39 


6 62 


32 


5 43 


93 


15 79 


23 


3 90 


63 


10.69 


21 


3 57 


15 


2 55 


21 


3 57 


45- 


7 64 


24 


4.08 


65 


' 1 1 .04 


27 


4.58 


24 


4 08 


23 


3.90 


24 


4 08 


9 


1 53 


42 


7 13 


65 


11.04 



TABLE 2 *• 

Rank Orderiog of Means for the Nine Occupational Groups 



Occupaljonal Group* 



Occupational Survival Skill v ' .4 2 3 4 

Means Above ^.50 for Every dccupational Group 
X2 be dependable' 379 3.72 3.83 3.84* 

Means Above 3.00 for Every, Occupational Group 

Xi2 give an honest day's work . ^ 33 3 42 . 3.54 "3 52 

Xt« know what is expected of you , . '3.27* 3.44 3.41 3 49 

X»o maintain good health *. , 3.13 3.31 3.33 3.36 

X2« manage time and materials efficiently^ ^3.31 *^3.59 ' '3 33 3.39 

Xt be punctual ^ : 3.00 '3.05 3 07 3.25 

Me,ans Above 2.50 for Every Occupational Group 

X22 follow instructions 3.05 2.98 3 52 3.72 

X23 work without close sujbervision ' 3.37 3.31 3 13 3 27 

X4 work as a team members 3.14 3.2i3 2.93 3.09 

X25 adjust to various wor'k siraations . 3 23 3.55 3.02 q.18 

Xn k'pow your own abilities.-^trengths and weaknesses 3.37 3 38 3.28 3 35 

'Xt3 be toyal to the organization for which you work . . . 2 81 3.39 ^ 3 33 3 34 

X^ get along with people with a variety of personalities 3.32 3.72 3 65 3.37 

X^9 locate information, materials or equipmerrt . . 3,38 3.02 2.93 3 16 

Xi4 make independent decision^ . 3.3t 3.47 3 22 2 86 



3.78 . 3.76 3 73 3.59 3 90 



3.46 
3.39 
3.24 
3 32 
3,55 



3.53 

3 30 

322 

3.42 

3.39, 

3.07 

3.16 

3.53 

3 16 



.'3.50 
3.44 
3.41 
3 40 
3 34 



3 56 
3r10 
3.09 
3 11 
3 27 
3 20 
3.00 
2,83' 
2.53 



3.29 
3.24' 
3 65 
310 
3.42 



3*38 
2.^2 
3.06 
313 
.q25 
2.96 
•'3.35 
•2 87 
2.92 



3.35 
3.24 
'3. 06 
3.06 
3.41 



, 3.41 
3.06 

2 94 
2.82 
^82f 

3 12' 
2,76 
2 53 
2 59 



3 80 
3 10 

3.70 
3 40 



3 30 
3*20 
2.90 
3 90 
3 60 
3 40 

2 90 

3 50 
3 70 




Means Above 2.00 for Every Occupational Group 



X21 


have a basic knowledge of your organization's . 


" ^' 




'3.30 




I 








3 50 




Is operating propedures .. . 


.... 2.85 


3.34 


3 05 


2.93 


2.87 


2 73 


2:41 




Xc 


understand written information, 


♦3.62 


' 3.53 


3 33 


3.56 


3.58 


2 91 




^.Jo * 


0 f\) 




X24 


work under tension or presiSure 


. 3.19 
3.34 


^3.34 


2.9a 


3 22^ 


2.92 


2.74 


3.12 


2 35 


3.20 




Xl5 


use initiative and imagination 


3.48 


3.30. 


2.88 


3.14 


a 59 


2.83 


2.29 


3,60 




X27 


follow safety regulations 


".^ ... 2.81 


2.75 


2.28 


2.66 


3.64 


3.63 


3.42 


3 59 


3.50 




Xlt 


knowh6w to use job material^ machines or tools 


'.. 2.84 


2.52 


2.24 


' 3.07 


3.55 


3.47 


2.87 


341 . 


3 70 




Xt 


have basic speaking skills, 


. . 3,37 


'3.31 


3.46 


3.16 


2.55 


2.21 


2.96 


2 24 


3.20 




Xa 


have basic arithmetic skills 


. . 2.94 


3.p2 


3.26 


2 92 


3.12 


2.67 


2.33 


2.18 


3.40 




X7 » 


have basic writing skills . . * 


. ... 3.19 


306- 


2.89* 


3 01 


2.55 


2.17 


2 48 


2.24 


2.80 





K5 

X, 

X20 



/ Means Above 1 

organize work activities of other people 

be neat and cle£^ in appearance 

have some type of specialized training 



50 for Every Occupational Group 
.. . 2.77 



2.97 
3.58 



Total number of respondents 



3.38 


2.28 


1.97 


2 65 


1.8a. 


2.25 


2.00 


3.40 


3.30 


3.61 


3 39 


2.26 


2 56 


3.44 


2 06 


1.80 


2.97 


2.43 


2.70 


3.35 


2.37 


2 87 


1.59 


3.10 


64 


46 


148 


74 


70 


52 


17 
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' 1 . Pro^fessioniil,' 'Technical. Kindred 
2 Mah^gers.^bfflwals, Proprietors 
3* Sales Workers . 



4 Clerical Workers 

5 Craftsmen. Fbremen. Kindred 

6 Operatives >' 



7 Service Workers ^ • ^ 

8 Laborers, except Farm " 

9 Farmers and Farm Workers 
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tnbutdd tQ. the maximal separation 
Of the occtTpational groups Of the 
8 functions (one less than the hum- 
ber of occupational groups), the first 
^three function^ were significant at 
the 001 level. The skills which maxi- 
mally drfferentiated among the 9 oc- 
cupational group^were determined 
by examining th6 standardized 
weights -associated w4th the 27 vari- 
ables for each of 'the significant 
flinctions. 

First Significant Discriminant Function 

The standardized weights for the first 
significant discriminant function are 
plotted tn Figure la By visual- exami-' 
nation of tpe weights, tt was de- 
termined that the five qccupational 
'survival skills whose weights are 
bracketed m Figure la contribute the 
greatest to the-differentiatio'n amqng 

^ groups 

The linear combination *for the 
first signiTicapt discriminant func- 
tion, showing only the five highest 
positive and negative weights, is^ ' 
^ Yr= -4 9^X1 +6.49X9..* 

-6 87Xi8 . -10.96X27.^ * ^ 

- . Occupational groups m'eans^for 
the first Significant discrl^hinant 
function are plotted in Figure lb. For 
the tirst function, it appears that the 
occupational groups axe basicaMy^ 
separated into two clusters — Groups 
1. 2, 3, 4, and 7, and Groups ^ §, 8. 
and 9. The occupational survival sVills 
associated with the, \Vfeights of the 
lirtear combination car) , now be 
viewed with respect to ^the clustering 
of the sample centroicis (me^in?) of 
the occupationa|^group^, 

The five-group^cluster, comprised 
of Professional Teohnic'^', Kindred 
(Gr" H^/Manag^rs, Officials. Prgiprie- 
tors (G/^), Safes Workers (Gr. 3), 
Clerical Workefs (Gr. 4K and Service 
Workers' (Gr. 7) are rnainly white col- 
lar workers* The occupational sur- 
vival skills which tend to cluster these 
five groups together are those skills - 
which are associated with the high 
positive and negative weights of the 
linear cornbination. These skills* also^ 



indicate ttfet the remaining four 
groups form a second cluster, Jn 
terms of the cluster,of high positive- 
weighted skills- versus the cluster of 
high negative-weighted skills, the 
occupational groups within each 
cluster are similar, whereas the two 
clusters do tend io differ from each 
other in respect to the 27 occupa- 
tional survival SkMJs under invbsti- 
'gation, 

With, respect to thS fiye-group clus- 
ter of occupations (white collar work- 
ers), the two skills with high positive 
weightSv(Figure la) can, be consid- 
ered extremfely important Vo. them. 
Consequently, occupational survival 
for white collar workers depends to 
a large extent on ^he skills of being 
neat and clean in appearance (Xs) 
and having basic speaking^ skills 
(Xs). • • 

To these same fivelgroups, occupa- 
tional survival IS not as dependent 
upon the'skills^oj (a) following safety 
regulations (X27); (b) knowing how 
to use job materials, machines or 
tools ('X18), and ^c) bping punctual 
(Xi). Figure la'indicates these three 
Skills have htgh negative weights, 
n The other four groups that are clus- 
tered together on. the first function 
are mainly persons who"^are blue 
collar workers These groups are 
comprised of Craftsmen, Foremen,' 
kindred (Gr^ 5). Operatives (Gr, 6-); 
Laborers, ekcept Farm (Gr'8), and 
Farmers and Farm Workers (Gr. 9), 
These four groups, in contrast to' 
vyhite collar workecs\ consider thai 
occupational survival depend? to-a 
l^rge -extent on (a) follovvjng* safety 
regulations (X27), (b) knowing how 
tq use jo^) materials.'machines'pr tools 
(Xi8).and (c) being punctual (Xi), Al- 
ternatively, the skills of basic speak- 
ing skills (Xe) and being neat and 
clearr in appepraJtce (X9) are of lesser 
importance to 'them for oocupational 
survival, 

Stcond Significant Discriminant . - 
Function 

The second significant discriminant 
function indicates maximal separa- 
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FIGURE.1 

First Significant Discriminant Function wrth the 27 Occupational Survival Skills (X,) 
and the Nine Occupajtional Groups 



a. Standardized discriminant weights 
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tion IS again between two clusters 
of occupational groups (Figure 2). 
One cluster is made up of four groups 
of occupations — Professional., Tech- 
nicaf, Kindred (Gr 1), Managers, 
Officials. Proprietors (Gr 2): Crafts- 
men, Foremen, Kindred (Gr 5); and 
Farmers and Fa/m Workers (Gr 9) 
These four groups include a large 
number of persons who are proprie- 
tors, managers, supervisors and fore- 
men 

The linear combination for the sec- 
ond-significant discriminant function, 
shOwtng only the three highest posi- 
tive and" negative weights, is 

Y2=5 10.94X5 12 77X20 
^-9.20X22 



Third Significant Discriminant Function 

On th4 third significant discriminant 
function, Groups 1, 2, 3, 4, 5^ 6, and 
8 are clustered together between 1he 
two outer extremes of Group 7 and 
Group 9 (Figure 3). Service Workers 
(Gr. 7) and Faj^mersarid Farm Workers 
(Gr. 9) are those occupational groups 
among which the 27 occupational 
survival skills maximally differentiate. 
Although these two groups are sepa- 
rated quite markedly from a large 
cluster of groups lying between them, 
care should be exercised m interpret- 
ing the results of this function. 

Farmers and Farm Workers repre- 
sent only about two percent of the 
total sample. Two percent is com- 



The skiUs which tend to clust^^T^ patible for representing the popula 
these four occupational groups to- tion from which the samplewsks taken 
gether including having some type 
of specialized training (X20) and or- 
ganizing work activitres of other peoy 
pie (Xs). These two skills appe^fc^^ 
be extremely important for mana-* 
genal-type personnel to pQSsess. 

ThejskiH which appears to be much 
less inopbrtant to these persons ^or 
occupational survival is the ability 
to follow instructions (X22). This does 
not seeoi unreasonable, since a lead- 
ership role should be appropnaffe 
fd? the management staff 

The othec cluster of ocGupatibn^ 
groups on the second function in- 
cludes five groups — Sales Workers 
(Gr. 3)f Clerical Workers (gGr 4); 
Oper^ves (Gr. 6); Service Workers 
(Gr 7); and Laborers, except Farm 
(Gr 8) — mainly subordinates. Con- 
sidering these worker's are primarily 
those -persons who carry out direc- 
tives of raanagement. It rs ,not un- 
realistic that a very impfortant occu- 
pational survival skill for them is 
thaf of following directions (X22) It 
follows, too, that job maintenance" ^ 
depends to a much lesser degree 
upon the skills of having somk^ type 
of specialized training (X20) and ^or- 
gahizing work activities of other 
people (Xs). * ♦ 



ibut It does not satisfy a/oasicVule of 
discriminant analysis/i e , that the 
size 'of the smallest group should not 
be less than the numbe\of var^bles 
used (Tatsuoka. 1970) Orjly 1(f per- 
sons represent Group 9, Farmersjand 
F&rm Workers This is an exbeption- 
atly small group considering there 
are 27 variables being studied in the 
discriminant functions (Note that 
Group 8, Laborers, except Farm, with 
17 persons is also a very small^ group) 
The linear combination for the third 
significant discriminant function, 
shoyiong only the five hfghest posi- 
tive *and*neg'afive weights, is- 
Y3 = . . '+9 41X9. ^-8 64Xi7' 
+ 9.23X^0.. -7 64X21 . 
7.68X27 

, Figure 3a indicates the standard- 
ized wfeights associated with the oc- 
cupational survival skills of the linear 
combination which maximally sepa- 
rates Service Workers^(Gr. 7) from 
Farmers and Farm Workers (Gr. 9) 
for the third significant function 
Service Workers are persons who are 
employed in food, health, personal, 
protective and household services, 
arfd Include such occupations as 
cooks, practical nurses, •airline stew- 
' ardesses, elevator operators, firemen, 
guards and policemen. Theiskills 



FIGURE 2 

Second Significant Discriminant Function with the 27 Occupational Survival Skills (Xi) 
and the 9 Occupational Groups 
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FIGURES \ / 

Third Significant Discriminant Function with the 27 Occupational Survival Skills (Xj) 
^ and the 9 Occupational Groups 
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which are considered to be extremely 
importatnt for occupational Si^rvival by 
jService Workers are 7a) being neat 
'and clean in appearance (Xg). (b) hav- 
ing some type of specialized training 
(X20) and (c) following safety regula- 
tions (X27) 

A skill which IS considered to be 
of lesser importance for occupational 
survival m the services area is having 
basic arithmetic skills (Xw). Having a 
basic knowledge of your organiza- 
tion's operating procedures (X21) is 
another skill which is not considered 
too vital Tor occupational-survival in ♦ 
a service career 

Farmers and Farm Workers (Gr. 9), 
on the other hand, consider that occu- 
pational survival Is related to having 
basic arithmetic skills (Xw) and hav- 
in'g a basic knowledge of your orga- 
nization's operating procedures (X21). 
The same* group indicated that of the 
27 skills rated, occupational survival 
depends the least upon the skills of 
(a) being neat and clean in appear- 
ance* (X9), (b) having some- type of 
specialized training (X20) and (c) fol- 
lowing safety regulations (X27) 

Most of the persons in Group 9 
(Farmers and Farm Workers) were 
farm owners, tenants and managers 
Mad the sample been larger, this may 
not have been true. 

Approximately 39. 29*and 11 per- 
cent of the to(Bl discriminability 
among groups is attributable to the 
first, second and third discriminant 
functions, respectively Consequently, 
approximately 80 percent of the total 
discriminating power of the battery 
as a whole is apportioned to the first 
three significant functions. 

OccuDitlonal Group Similarities 
intf Oifawncis 

The group centroids for each of the 
three significant discriminant func-^ 
tionsare graphed m Figure 4. Whereas 
Figures lb, 2b and 3b present the 
first, second and third significant dis- 
criminant functions, respectively, all 
three significant discriminant func- 
tions can be examined m relation^to 
eachother^n Figure 4 



Note that Professional, Technical, 
Kindred {Gr. 1) and Managers. Offi- 
cials, Proprietors (Gr 2) arejiclus- 
tered together for each of the three 
Significant discriminant functions. 
Since the 27 variables of the present 
study do not differentiate between 
these two groups, the occupational 
survival skills which are necessary 
for workers in one occupational clas- 
sification appear to be of equal im- 
portance to the workers in the other 
occu'pational group. The same would 
hold true concerrrmg the occupa- 
tional survival skills of lesser im- 
portance. That IS, the occupational 
survival skills which are of lesser 
importance to workers m the Profes- 
sional, Technical, Kindred group also 
appear to be of lesser importance 
to the workers in the group of Man- 
agers, Officials, Proprietors, 

Two other, occupational groups, 
^Operatives (Gr. 6) and Laborers, ex- 
cept Farm (Gr, 8), also, are clustered 
together*foV each of the three signifi- 
cant discriminant functions. Similarly, 
the occupational survival skills ofi 
the present study which are important 
to workers in the Operatives group 
appear to be equally important to the 
workers m the Laborers, except Farm 
group. The skills of lesser importance 
to one group also appear to be of 
lesser importance to the other group 

SUMMARY 

The present study has illustrated that 
there are some iDasic knowledges, 
traits and competencies that are 
common to all types of oqcupations. 
It appears that persons must possess 
many (or at least some degree of all) 
of these knowledges, traits and com- 
petencies for successful maintenance 
of an occupation. 

OI the 27 occupationcll survival 
skills identified and compared in this 
study, 10 skills contributed to the 
maximal separation of two or more 
of the 9 occupational groups These 
10 occupational survival skills can 
be. considered as those job knowl- 
edges, traits or competencies which 
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FIGURE 4 

Group Means for the 3 Significant Discriminant Functions (Yi, Y2, and Ya) 
with the 27 Occupational Survival^kills and the 9 Occupational Groups 
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Occupatlonat Groups Referred to In Diagrams 



1 ^ Professional, Technical, Kindred 

2 - Managers^ Officials. Proprietors 

3 Sales' Workers ' 

4 ~ Clerical Workers • 

5 - Craftsmen, Forepien, Kindfed 



6 = Operatives 

7 = Service Workers 

8= Laborers, except Farm 
9 ~ Farmers and Farm Workers 
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X9 

Xl7 

X18 
X20 



X22 
X27 

The 



are more important for job mainte- 
nance for certairv types^of occupa- 
tions than they are for otheV^'type&of 
Occupations: 

Xt to be punctual 
Xs to organize work activities 
of other people 
to have basic speaking sKills 
to be neat and clean in ap- 
pearance 
to have basic arithmetic skills 
to know how to use job ma- 
terials, machines or tools 
to have some type of special- ^ 
" ized training ^ 
to have a basic knowledge 
of your organization's op- 
erating procedures 
tojollow instructions 
to folloyv safety ^regulations 

occupational^ survival skills'" 
compared in the present study, hovy- 
ever, do not appear to discriminate 
^between the occupations which com- 
prise ihe groups of Professional, 
Technical, Kindred (fer. 1) and Man- 
agers, Officials, Proprietors (Gr. 2)l 
Likewise, workers of the study popu- 
lation comprising the groups of Oper- 
atives (Gr 6) and Laborers, except 
Farrt) (Gr 8fdo not differ in the types ^ 
of skills (at least in terms of the 27, 
variables o| the present study) the'/ 
feet are important or are of a lesser 
degree of importance for occupa- 
tional survival. 

The other 17 occupational survival 
Skills, however, did not appear to dis- 
criminate between or among groups. 
That IS, when the 27 Occupational 
survivaj skills were statistically tesjed 
by discriminant analysis ^or determin- 
ing differences among the 2. occupa- 
tional groups, 17 skills did not con^ 
tribute appreciably to any significant 
differences Consequently, the follow- 
ing 17 skills appear to be important 
for "occupational survival regardless 
of occupational' classification. 

^ X2 to be dependable 
X3 to get along wjih people with 

a variety of personalities 
X4 to work as a team member 



X7- 
X10 
X11 

X,2 
Xi3 

Xl4 



Xl6 



X23 



to understand vyritten infor- 

matw K 
to have oasic writing skills 
to maintain good health 
to know your own abilities, 
strengths and weaknesses 
to give an honest day's work 
to be loyal to the organiza-^ 

tion for which you work 
to make independent deci- 
sions 

to use initiative and imagina- 
tion 

to know what is expected of 
you 

to locate infomation, ^mate- 
rials or equipment'' 
to work without close super- 
vision 

X24 to work under tension or 
pressure • 

X25 to adjust to various work 
situations 

X26 to manage time and mate- 
rials efficiently 

Since occupational group sjmilari- 
^ies as well as priority differenced 
were found in the types of skills 
workers need for occupational sur- 
vival, both of the present study's hy- 
j)dtheses were supported (1) there 
are occupational survival skills which 
appear to be important for workers in 
all types of occupations and (2) there 
.are occupational survival skills which 
appear to be more impprtant forwork- 
^ers ia certain types 61 occupations 
than they" are for workers in other^ 
types of occupations. 

Even though similarities and pri- 
ority differences were found in the 
types of survival skills workers con- 
-sider important, none of the 27 skills 
were rated as being totally unim- 
portant by any occupational group 
Consequently, each of the 27 occupa- 
tional survival skills rated by respon- 
dents in each of the 9 occupational 
groups can be considered to have 
some degree of irpportance for occu- 
pational survival. 

- It was not the intent of this study to 
deal directly with attitudes of workers 
toward satisfaction or dissatisfac- 
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tion with their jobs, but the aspect 
of work satisfaction is difficult to 
;^nore when job information is de- 
sired. In answering one of the three 
open-ended questions concerning 
-work satisfaction.' nearly 90 percent 
of the 589 respondents indicated that 
they^ keep their jobs because of sal- 
ary.' security or work satisfaction 
Secondly, no one pnnnary reason was 
V given for drsliking their jobs, how- 

ever, interpersonal relations was th^ 
, - reason cited most often by workers 

; ' who did find an aspect of their jobs 

I they disliked. As a third descriptive 

\' characteristic Of the sample, the nna- 

jority of respondents who' had held 
previous jobs^ indicated that some 
I tnnportant personal reason was the 

primary factor as to why they left 
their last jobs (Nelson and O'Neil. in 
press. O'Neil. 1976) 

Work satisfaction n^ot only ap- 
pears to be an important .reason why 
people work, but why people pursue 
various types of jobs Smce mc^reas- 
\nQ occupational mobility is becom- 
ing more evident, factors concerning 
^ )0b changing also may be important 
aspects relating to work satisfaction 
Needs dtid desires of individuals are 
■ J met through work Knowing how to' 
successfully survive in an occupation 
as a member of a mobOe work force 
certainly gives additional meaning to 
preparing oneself with occupational 
survival skills — the knowledges, 
traits and competencies for success- 
ful maintenance of a job 

Based on the results of the present 
study, curriculum miaterials arfe being 
developed w.hich will assist in pre- 
paring workers for successful job 
maintenance. The implications of job 
survival skill training maV provide 
workers with more freedom of occu- 
pational mobility whereby they may 
obtaif^ greater satisfaction and a 
higher sense of achievement ^rom 
their jobs 
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influence of Reading Ability and Verbal Modality 
on Principle Learning of Vocational Students 
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Improvement of learning situations 
for individual Students has received 
increased attention in the literature 
in recent years. Alternate approaches 
to developing materials and design- 
ing delivery systems to meet the Indi- 
vidual needs of learners must be ex- 
plored Weisgerber (1972) pointed out 
that: 

While instruction and learning are cus- 
tomarily taken as givens" in education, 
and learning has been thought of as the 
consequepce of instruction, it is clear that 
instruction can take place for a group in 
which certain students fait to learn (p.1) 

Recent emp'hases on individual- 
ized instruction reflect an acceptance 
by the educatiorlal system of/espon- 
•sibil;ty to give consideration to the 
learrjing needs of each stuefent. 

Ediing (1970)^ reported that al- 
though there 4s apparent agreement 
on th^ need for individualized instruc- 
tion, a comparison of forty-six indi- 
vidualized programs indicated sig- 
riificant.differences in the degree and 
kind of individualization used. Smith 
(1971) offered some clarification of 
the problem when he described five 
ways-in which Instruction can be 
individualized The five ways were 

I. Rate Individualization 

2 Remediallndividualization 



3 Proficiency Individualization 

4. Objective Individualization 

5. -^Method Individualization 

•With regard to method individualiza- 
tion, Smith (1971) stated: 
There is a hope frequently expressed that 
It ma/be possible to identify m advance 
students who can lea/n better by one 
* method than by another. Each student 
could tfien learn from the method which is 
most effective for him (p. 190). 

The need for instructional resources 
in vanous formats containing com- 
parable exposition of subject mattei* 
content is implicit In the concept 'of 
"method individualization " Provid- 
ing instructional materials m alter- 
nate formats would also appear to 
be justified by the differences in 
learning style which have been dem- 
onstrated by past research. 

On6 of the ways In which learning 
styles differ is learning modality. 
Wepman (1971) asserted that: 
Each child (and later each 'adult) shows 
a preferred pathway for acquiririg infor- 
mation Children who prefer the auditory 
pathway appear never to lose this prefer- 
ehce_but .remain auditory Jearners all of 
their lives (p. 56). 

This position was noted earlier by 
Sticht (1969) in a study of Army re- 
cruits conducted by the l^uman Re- 
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sources Research Organization One 
fourth of a sample indicated that they 
would prefer to listen to rather than 
- read information. For recruits classi- 
fied as poor readers, the figures rose 
to approximately one-half Wepman 
(1971) wrote: 

Fortunately, marked differences in learn- 
ing via the modalities has relatively little 
incidence among average children 
The nonaverage child, however, in whom 
one modality is strongly dominant and 
others relatively weak, needs careful con- 
sideration About 25 percent of chtldren 
entering school wHI have one modality that ^ 
IS definitely superior to all others (p 56) 

This was not the case, however, for 
the male vocational education stu- 
dent population According to Evans 
and Galloway (1971), the Q/eat ma- 
jority of this population falls be- 
low the median of the total second- 
ary school population on measures 
of academic achievement "Wepman 
(1971) pointed out that poor achieve- 
ment IS not unusual for students in 
the upper grades who have defi- 
ciencies m specific learning modal- 
ity development. 

. The failure to provide for differ- 
ences in learning style, particularly 
with regard to verbal ability, can be 
traced to a lack of conclusive evi- 
dence which relates media format 
to learning modality for the various 
types of instructional tasks However, 
as Gagne (1965) pointed out. "Sev: 
eral studies have shown that pictorial 
representations may be more effec- 
tive than printed text for those who 
have reading difficulties or small 
vocabularies (p 364) ' It is, therefore, 
not surprising that pictorial represen- 
tations "^re emphasized in individ- 
ualized materials, however, they are 
usually accSffipahied by verbal infor- 
mation The following question re- 
mains unanswered. Should the verljal 
information be available^n visual for- 
mat (printed) and in auditory format 
(recorded) so that students may select 
the format which they as individuals 
prefer'' 
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Most irtstructional materials com- 
bine pictorial representations with 
either a visual-verbal format, or an 
auditory-verbal format However, if^ 
the needs of students who have a 
dominant learning modality are to 
be met, it would seem that both verbal 
formats aVe necessary There is little 
evidence regarding the manner in^ 
which verbal modality interacts with 
student characteristics for particular 
types of instructional tasks. Without 
such information it is difficult to jus- 
tify preparation of alternate ^ver^ions 
of instructional content. 

Therefore, it was the purpose of 
this investigation to compare the 
effects of pictorial representations 
when accompanied by visual-verbal 
or auditory-verbal information on 
performance. 

More specifically, the study at- 
tempted to answer the following ques- 
tions: 

1. To what extent does the perfor- 
mance of students vary ^hen they 
receive identical conteritjfi^different 
verbal formats accompanied by pic- 
torial representations'' 

2. To what extent do reading ability 
and verbarformat interact to affect 
performance'' 

METHODS 

In order to answer these questions, 
four hypotheses were developed and 
then tested at the 05 level of sig-^ 
ificance. 

The study was conducted as a 2 x 2 
randomized factorial design with 
replication as shown in Figure 1 The 
independent variables were verbal 
format, a method variable, and read- 
ing ability, an organismic variable 
The dependent variable was perfor- 
mance. 

Two perf6rmance objectives were 
identified and an instructional sys- 
tems Approach was used to prepare 
a learning unit for each objective 
The first unit (Reading a Meter ^cale) 
was almost exclusively cognitive m 
nature, vvhile the second unit (Mea- 
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FIGURE 1 

Design of the Study 



' LEARNING UNIT 1 
READING TREATMENT TREATMENT 
ABILITY - A B 



HIGH 



15 



15 



LOW 



15 



15 



TREATMENT A 
Pictorial with 
auditory-verbal 
Formative 
evaluation 



TREATMENT B 
Pictorial with 
visual-verbal 
Formative 
evaluation 



LEARNING UNIT 2 
READING TREATMENT TREATMENT 
ABILITY A B ' 



HIGH 



LOW 



15 
15 



15 



15 



TREATMENT A 
Pictorial with 
visual-verbal 
Formative 
evaluation 



TREATMENT B 
Pictonal with 
auditory-verbal 
Formative 
evaluation 



Summalive Summalive 
• evaluation " evaluation 
Indicate preferred Indicate preferred 
verbal formal verbal format 

sunng DC Voltage with the Volt- 
ohmmeter) was considered" to be pri- 
marily psychomotor in nature. In unit 
two. students were required to ma- 
nipulate physical objects These units 
consisted of a senes of slides accom- 
panied by verbal information The 
verbal information foj both units' was 
prepared in two al&lnate formats 
recorded tape (aural), and printed 
(visual) 

High readhipg ability, defined as 
reading at or above tenth grade level, 
and low readmg^^ilily. defined as 
reading below eighth grade level 
were arrived at upon analysis of the 
readability level of the verbal mfor- 
nrration prepared for the study 



SUBJECTS 

A standardized reading test was ad- 
ministered to 115 ten<h, eleventh and 
twelfth grade male students enrolled 
in the first year trade electricity pro- 
gram at the County Center, an area 
occupational school in Weslbury, 
New York. Thirty high reading ability 
students and thirty low reading abil- 
ity students 'were randomly assigned 
to each of the two treatment groups. 

PROCEDURES 

The subjects in each treatment group 
commenced Learning Unit 1 at the 
same time. Each student received 
materials designed for individual 
study A posltesl was administered 
as each student completed this unit 
After this posttest, Learning Unit 2 
was Initiated A posttest covenng the 
material in the second lesson was 
administered after it was completed. 
All students then received a summa- 
tive evaluation covering the materials 
in both learning units The final item 
in the summalive evaluation^ re- 
quested that students indicate the 
verbal formal they would prefer for 
a subsequent learning unit Both 
posttests and the summalive evalua- 
tion were rated and scoced in accor- 
dance with procedures that had been 
agreed to and practiced prior to the 
experiment. 

RESULTS 

The two verbal formats treated in this 
study were aural (recorded tape) and 
visual (prmled page) The two read- 
\ing ability levels were identified as" 
high and low .Prmciple learning was 
measured by a performance posttest 
administered upon completion of each 
learning unit Four hypotheses were 
stated in the null form for purposes of 
testing 

The first hypothesis was 
HOi No significant difference exists 
between Ihe performance pn for- 
mative evaluation of students 
who were experiencing the two 
verbal formats in Learning Unit'l 
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A two-way analysis of variance of per- 
formance scores on'Learnmg Unit 1 
was conducted. The results of this 
analysis, reported -in Table 1, indk 
cated a significant difference betvyeen 
the levels of performance for the two 
verbal formats treated in this study 
Students who experienced the visual 
format (printed page) performed sig- . 
niffcantly different than those who 
experienced the aural format (re- 
torded tape) Therefore. Hoi was re- 
jected 

The second hypothesis was^ 
H02 No Significant difference exists 
between the perfornnance on 
formative evaluation of students 
who were experiencing two ver- 
bal formats in Learning Unit 2 

The performance scores of Learning 
Unit 2 were subjected' to a two-way 
analysis of variance, the results of 
which appear in Table 2 This anal- 
ysis did not reveal any significant 
difference in performance between 
students who experienced different 
verbal formats Therefore. H02 was 
not rejected 

The third hypothesis was. 
Ho3 No significant differ^ce exists 
between the performance on 
formative evaluation on high and 
low ability readers 

This hypothesis was rejected for both 
Learning Unit 1 and 2 on the basis of 

TABLE 1 

Analysis oHi^a^iance in Performance 
on Formative Evaluation 
for Learning Unit 1 



Sum of Mean 
Source Squares df Square F 



Verbal Formal 39 1 39 4 56* 

Reaclrng Ability 202 1 202 23 63*' 

Interaction 20 1 20 2 34 

Within Groups 479 56 8 55 



TOTAL 740 59 

• Significant at 05 ^eve^ ~ 




the analysis of variance in perfor- 
mance scores for each learning unit 
as reported in Tables 1 and 2. 

The fourth hypothesis was 
H04. No significant interaction exists 
between verbal format ajtd level 
of reading abHity regard to 
performance on formative evalu- 
ation 

Interaction between verbal format and 
level of reading ability was not sup- 
ported by the data of either learning 
unit as reported in Tables 1 and .2. 
Therefore, H04 was not rejected. 

The significant findings regarding 
veybal format, reading ability and in- 
teraction have been tabulated for both- 
learning units and are presented in 
Tables. 

TABLE 2 



Analysis^of Vanance m Performance 
on Formative EvaTuation 
for Learning Unit 2 ^ 





Sum of 




Mean 




Source 


Squares 


df 


Squiare 


F 


Verbal format 


37 


1 


37 


3 56 


Reading Ability 


84 


1 


84 


8 09* 


Interaction 


1 


1 


1 


0 


Within Groups 


581 


56 


10 38 




TOTAL 


702 


59 







* Significant at 05 level 



TABLE 3 

Significant Fincfings for Learning 
Units 1 and 2 



performance 

Source 

Unit^^ Unit 2 
Verbal Format SIgW|* NS 
Reading Ability SIG ' SIG 
Interaction ^ NS NS 

SIG = Significant at 05 level 
NS = Not significant 



OlSCUSSjON 

The findings of the study indicated 
that high reading ability students per- 
formed significantly higher than low 
reading ability students on the post- 
test that followed each learning unit. 

However, tiiere was a lack of con- 
sistency in findings of performance 
as It related to the different verbal 
formats. Students in group B who 
experienced the visual-verbal format 
in Learning Unit 1 were found to have 
a significantly higher score than treat- 
ment group A students who experi- 
enced the aural-verbal format In 
Learning Unit 2, students in treatment 
group B did not perform significantly 
different when the. verbal formats 
were reversed At this point one would 
suspect that the difference in perfor- 
mance levels was due to differences 
in the composition of the treatment 
groups. However, this conclusion was 
not substantiated by the data used to 
establish the equality of the twp treat- 
*menl groups. It is the invesfigators' 
opinion that the differences m. per- 
formance can be attributed to differ- 
ences in the match between instruc- 
tional objectives and verbal format 
for the two learning units. Although 
principle learning was the objective 
of both learning units, in the first 
(Readir>^ a Meter Scale) it wa's almost 
exclusively cognitive, while in the 
second (Measuring DC Voltage with 
the Volt-ohmmeter) it was primarily 
psychomotor, a«d students were re- 
quired to manipulate physical objects. 
(I is^suggested that the inherent abil- 
ity to go back and review the verbal 
information in the printed format was 
more facilitating to the cognitive task, 
while the lack of physical distraction 
afforded by the recorded format facili- 
tated performance on the psycho- 
motor task of Learning Unit 2. It is, 
therefore, sugge*sted that both level 
of learning and domain of knowledge 
should be considered when judging 
the equality of two instructional 
objectives. 
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Cogi^itive Interaction and Learning 



DOROTHY KIZER 
Prairie View A. and M. 
University 

W.IVIARGUERITE SCRUGGS 
Oklahoma State University 
Competency-based education in home 
economics currently assumes the 
validity of many of the competencies 
required of prospective home eco- 
nomics teachers. The present study 
dealt wi\h o^ problem that must be 
solved before the predictive validity 
of competencies can be established, 
namely, the relationship between what 
a teacher does m the classroom and 
student learning 

♦Although many 'studies have dealt 
with the affective domain of student 
learning (Gage. 1972, p 127), the 
relationship between classroom be- 
havior of teacJ^ers and students and 
* cognitive learning has been relatively 
neglected in research Teachers use 
20 to 30 percent of classroom time 
in teacher-student discussion (Nut- 
hall and Snook. 1973. p. 52), but little 
IS known about the relationship be- 
tween various cognitive levels of 
classroom discussion and student 
achievement (Rosenshine and Furst, 
1971). 

Neither the current state of knbwl- 
edge of teaching (Nuthall and Snook, 
1973. p 49) nor the extent to whith 
intervening variables could be con- 
trolled in the present research per- 
mitted a definitive study. Rather, the 
findings are presented here to stimu- 
late hypothesis development arid fa- 
cilitate improved resparch design (or 
further studies of teaching 



OBJECTIVES ^ 

The principal objective of the study 
wa^ to determine the relationship 
between levels of cognitive interac- 
tion m the classroom and student 
learning Secondary objectives wdfe 
jl) to describe cognitive interaction 
in the home economics classes and 
(2) to examine educational ability, 
length of unit, and learning climate 
as intervening variables between cog- 
nitive Interaction and student learning 

CONCEPTUAL MODEL 

The conceptual model for this re- 
search was derived from the evalua- 
tion model of Smith (1971), As shown 
in Figure 1, the model contains, the 
following components input, setting, 
including school, class, and unit of 
study, a triad of relationships among 
teacher, students, and concepts, and 
output The model reflects elements 
of two types of models described by 
Nuthall and Snook (1973. p 49) as 
'discovery-learning" and rational 
Although useful for this research, 
the depicted system of relationships 
needs much more develppment and 
testing before it can meet the criteria 
fdr judging theories of teaching sum- 
marized by Snow (1973, pp. 103-106) 
The input component includes what 
students brmg to a learning situation 
(Gagne, 1970, pp 66-67) *hr» this study, 
input was represented by the general 
educational abilities of students as 
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FIGURE 1 

Conceptual Model 




\ 




measured by the Iowa Tests of Edu- 
cational Development (University of 
Iowa. 1970). . 

The setting component, or learn- 
ing situation, IS composed of the 
school, class, and unit of study. 
School was associated with teacher 
in the present study, with each teacher 
being from a different school. Class 
was represented by one home eco- 
nomics class from each school as 
well as a comparable group of stu- 
dents not enrolled in the class. All 
students were juniors or seniors in 
high school. The aspect of class ex- 
amined was the learning climate as 
measured by the Student "Setimate of 
Teacher Concern (Zimmerman, 1971) 
and the Learning Environment Inven- 
tory (Anderson, 1971). Unit of study 
wa;5 limited to the child development 
area. A core of Instructional objec- 
tives was assumed to be common to 
all of the home economics classes, 
as suggested in Iowa currlcular ma- 
terial (Iowa Department of Public 
Instruction, 1968) and as documented 
in the teacher's stated objectives 

The dynamic component of the con- 
ceptual model in Figure 1 is the cen- 
tral triad which represents the actual 
,teachlng process involving interac- 
tions among the teacher, students, 
and concepts. Hyman (1967, p 68) 
stated that a dynamic quality "is im- 



plied in the triadic conception of 
teaching because as the relationship 
between teacher and pupil changes, 
...the teacher must continually 
change his relationship with" the 
concept. In this study, the interac- 
tions dealt with concepts of child 
development and were described in 
terms of levels of cognitive behavior 
as categorized by a system developed 
by Prun (1971), the Brun Cognitive 
Interaction System (BCIS) 

The final component of the model, 
output is the learning attained by 
the students Learning was assessed 
m this study by means of the Children 
and Childhood test, an adaptation of 
a test by Clover (1973). 

SAMPLE 

The population (5f^eachers consisted 
of the 29 home economics educa- 
tion majors who graduated from Iowa 
State University in 1971 and who 
were teaching m Iowa during the 
second semester of the 1971-72 
school year. The sample of teachers 
was composed of all who were teach- 
ing a^child development unit in an 
eleventh or twelfth grade horpe eco- 
nomics class between March 1 and 
the end of th^ school year. All 17 
teachers who met this requirement 
were willing to participate, however, 
only 13 actually took part because of 
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scheduling confhcts in four schools 
. The second stage of the sampling 
involved selection of student groups 
The 345 elevent^h- and twelfth-grade 
students participating m the study 
consisted of twd groups from each 
of, the 13 high schools The class 
groirp was composed of students in 
the specified home economics class 
The control group consisted of stu- 
dents similar in educational back- 
ground, and of the same grade levels 
and sex as class members, but who 
were not enrolled in the home eco- 
nomics class and had not studied 
child development the year of the 
study. 

Several controls were built into 
the sample selection All the teachers 
were graduated from the same under- 
graduate program, had comparable 
preparation in. child development 
and cognitive interaction. Teacher 
behaviors were predominantly at the 
apply level (Category 2), with one- 
fourth of the teachers exhibiting no 
behavior higher than that level 

Median cognitive levels were cal- 
culated for teacher arid student be- 
haviors for each session (Category 
0 was omitted) In session I, teacher 
medians ranged from 1 38 to 2.02. 
student medians, from 1 23 to 1.90 
(^= recall, 2= apply). The ranges 
in'medians were, similar for session 
II, 1 41 to 2.03 for teacher behavior 
and 1 32 to 1 96 for student behavior 
Thus, median ^cognitive levels of be- 
havior were similar for teachers, stu- 
dents,, and sessions 

StudWs responded at the cogni- 
tive level elicited by the teacher over 
80 percent of the time in terms of all 
pairs of teacher-student behaviors in 
the total study yVithin any one class, 
the pairs of teacher-student behav- 
iors m which both behaviors were at 
the samejevel ranged from 60.2 to 
966 percent for session I and from 
634 to 94.3 percent for session II 
For most classes, the percentages 
were similar for the two sessions. 

More of the teacher-student pairs 
of behaviors with unequal cognitive 
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levels showed higher behaviors for 
the teacher than for the student 
This finding appears consistent with 
the idea that teachers stimulate stu- 
dents to deal with information on 
progressively higher cognitive levels 
Flanders '(1^70, p. 425) suggested 
the usefulness of investigating vari- 
ation patterns of teaching behavior 
In the present study, variation pat- 
terns were quantified by calculating 
the percentage of each teachers be- 
haviors which djffered in cognitive 
level from her preceding behavior 
The var-riation in a class session 
ranged from 4 6 to 40 7 percent In 
general, the teachers varied less in' 
the second session than in the first, 
although differences between ses- 
sions were smaller than differences 
among teachers Only three teachers 
varied between ses$(ons a/ much, as 
10 percent. 

DESCRIPTION OF STUDENT LFARNING 

Learning of students was assessed 
by an achievement test designed to 
measure the five levels of cognitive 
behavior represented by the five 
behavioral levels of the BCIS. A test 
developed by Clover (1973) to mea- 
sure basic child development con- 
cepts in home economics III classes 
was Adapted. A panel of judges in 
child development and home eco- 
nomics education validated the cog- 
nition level assessed by each item 
and the accuracy of content The 
final form of the test consisted of 
42 Items with a possil^ score of 55. 

The teachers administered the, test 
to members of their classes and con- 
trol groups The*total test score for 
each student was used to obtain mean 
scores for each class and each con- 
trol group. , 

The reliapility of this measure of 
student Jer^rnmg was estimated by 
using the spirt-half procedure In- 
ternal^consistency of the test per- 
forrnanoe of the groups of students 
(classes and control groups) was esti- 
mated on the basis of the total test 
scores for^the two halves of each 




group. This was appropriate be- 
cause group scores rather than indi- 
vidual scores were to be used as a 
.measure of learning in a class. The 
scores of individuals in a class are 
not independent, each replicates a 
nrteasure of learning in the class The 
process involved randomly assignirfg 
members of each class (or control 
^ group) to two groups, using mean 
test scpi'es from each half-class m 
the correlation procedure, and cor- 
recting for attenuation The estimate 
of reliability thus obtained was 48 
for the class groups and 69 for the 
control groups. 

These estimates reflected a portion 
of the difficulty in assessing higher 
cognitive processes, particularly of 
the fifth level of achievement, creslte 
The lower estimate of reliability for 
the scores of the class groups w§is 
due partially to the small number m 
the study and to the wide range of 
general educational ability within 
some small classes In one class, 
percentile ranks on the Iowa Tests 
pf Edxicational Development (ITED) 
ranged from 1 to 99 By chance the 
two halves of the class had mean 
ITED percentile ranks of 17 and 67 
Results for this and two other similar 
classes contributed substantially ta 
the low reliability coefficent 

To determine if the achievement 
test differentiated ^mong the classes 
and contfol groups, a one-way anal- 
ysis of variance was performed^ Using 
the mean test scores of the 26 class 
and control groups, an F value of 2 59 
(p O0iy was obtained Jhe achieve- 
ment test did differentiate among the 
groups * 

Student scores on the Children and 
Childhood test yielded a range of 
.class mean scores from 23 50 to 32 33 
and control group mean scores from. 
20 93 to 29 28 Assuming that class 
and control groups were comparable 
in ability, the difference between the 
^mean scores for the cla'ss and control 
"group in each school was assumed 
to reflect learning attributable to the 
class, and also served as a control 



for school differences that could have 
affected test performartces. 

DESCRIPTION OF INTERVENING ^ 

VARIABLES 
» 

Since the primary purpose of the 
study was to examine the relation- 
ship between cognitive interaction 
and learning within the natural set- 
ting of classrooms, a number^of inter- 
vening variable^ needed to be ac- 
counted for in the analysis These 
variables are the components input 
and setting in the conceptual model. 

The student Iowa Tests of Educa- 
tional Development (ITED) percen- 
tile ranks and information on length 
of units of study were supplied by 
the teachers Data on classroom learn- 
ing climate were obtained from the 
Learning Environment Inventory (LEI) 
and the Student Estimate of Teacher 
Concern (SETC) administered to class 
and controLgroups students by teach- 
ers. Students placed their responses 
in an envelope which was sealed be- 
. fore they left class to reassure them 
that the teacher would not see the. 
responses This procedure, reported. . 
by Zimmerman (.1971, p 82), was used 
to insure that students would re- 
spond freely to the instrument." 

The mean ITED percentile ranks for 
class'groups ranged from 35,69 to 
53 69, for control^ groups, from 38 71 
to 67.78. Althoug'h the class groups 
and their respective control groups 
were similar in educational back- 
ground, the class groups were signifi- 
cantly lower in educational ability 
mec^sured by the ITED. Results of a 
f-test of difference of means of ITED 
percentile ranks of classes and con- 
trol groups yielded a value of 4.01 
(P < Qi)t) . 

Four scales of the LEI, Environment, 
Goal Direction, Satisfaction,' and 
Apathy, were used separately Each 
of these scales had a possible score 
of 28. According to the student re- 
sponses, class means ranged from 
13.29 to 22.38 on Environment, 13.90 
to 23.25 on Goal Direction. U.80 to 
21.24 on Satisfaction, and 12.00 ta 
21.3tf on Apathy, . ' ^ ^ 
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The other measure of learning cli- 
mate was obtained from a cluster of 
39 Items selected from the SETC by 
Zimmerman (1971). Student re- 
sponsesS>efcled mean class scores 
ranging from 11 70 to 35 57. out of a 
possible score of 39* ' - 

RELATIONSHIP AMONG COGNITIVE o 
INTERACTION, STUDENT LEARNING, 
AND INTERVENING VARIABLES 

Computer-generated scatterplots y/ere 
visually inspected to determine rela- 
tionships between pairs of variables. 
The variables examined were levels 
of cognitive interaction, educational 
ability, length of unit, and learning- 
climate. 

When no other vanables v^re con- 
sidered, the rhedian levels of cogni- 
tive behaviors of teachers and stu- 
dents were not related to student 
learning ^ measdred by mean test 
scores for classes. Figure 2 is a repre- 



sentative scatterplot illustrating this 
, finding. The extent to which pairs of 
teacher-student behaviors were of 
the same or different cogaitive levels 
was also examined, but appeared not 
to be associated with learning either. 

With the exception of Schools D 
and H in Figure 3, a linear relation- 
ship* is depicted between variation 
patterns in cognitive behavior of stu- 
dents and student learning. Educa- 
tional ability .of students \^as a pos- 
sible reason for the location of 
Schools D and H on the scatterplot 
The class members in 'School D not 
only had the highest mean ITED per- 
centile (53.69) of all classes, but their 
educational ability appeared to be 
representative of the school. The -ITED 
mean for the control group exceeded 
levels of learning This exploratory 
study was undertaken to furnish clues 
which might aid in understanding 
this phenomenon. 



FIGURE 2 

Relation between Class Mean 
Test Scores and Median *Levels 
of Teachers' Cognitive Behavior 
for Session II (letters represent 

schools, number subscripts 
indicate length of unit In weeks) 



FIGURE 3 

Relation between Variation Pattern 
of Sequent Behaviors of Teachers 
for Session II and Class Test Mean 
Scores (axes are reversed to 
depict range more clearly in 
variation patterns) 
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FIGURE 4 

Differences between Class and 
Control Group Mean Test Scores 
as Related to Differences on lTED 
{letters represent schools; 

subscr^ft>ts indicate lengths o{ 
^ ^units m weeks) 
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t\ The sample included 13 first-year 
iiome econpmics teachers who were 
-"graduates of the same undergraduate 
■|?program. their eleventh and twelfth 
.r^rade homemaking classes, and con- 
*^(rol groups of students from each 
,>chool. Videotaped classroom dis- 
-Ncussions of teachers and students 
/.were analyzed according to the BCIS 
^ jn terms of levels of cognitive be- 
.haviors exhibited. Various measures 
cognitive interaction included fre- 
j^oency of behaviors at each level, 
median levels of cognitive behaviors 
in which the level of the pair of be- 
Jraviors was th(B same or* different, 
'^nd variation patterns of sequent 
behaviors. 

' Student learning, was assessed by 
means of an achievement test admin- 
istered to the classes at the end of a 
fchild development unit and to control 



FIGURE 5 

Relation of Class Mean Test 
Scores to Weeks in Unit of Study 
(letters represent scbaols; 
subscripts indicate number of 
weeks in unit) 
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groups who had not participated la 
the unit. The test included all five 
levels of cognitive behavior. , 

Educational ability of the students, 
length of the unit, and learning cli-/ 
mate were considered as variables 
affecting student learning. • 

When considered alone, median 
levels of cognitive behaviors af, teach- 
ers and students' were not related 
to stCident learning. However, anal- 
yses incorporating results for all stu- 
dents in regard to educational ability 
and performance on the achievement 
test supported the hypothesis of a 
relationship between student learn- 
ing and certain variation of median 
levels of cognitive behavior over time. 
Varied patterns of teacher behaviors 
appeared to be related to student 
learning. 

Results of this exploratory study 
were sufficiently encouraging to sug- 
gest that additional research be con- 
ducted to refine and clevelop mea- 
sures jof cognitive interaction within 
the classroom as a means of testing 
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relationships fcetween levels of cog- 
nitive behaviorand cognitive learning 
of students. It is recommended that 
all variables identified as iQput or as 
settmg be incorporated in future 
studies. Increased control of com- 
^ parability of class and cor^trol groups, 
and of such variables as length of unit 
and educatipnal objectives, should in- 
creasingly clarify results. ' ' 
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Personal Characteristics as a ivfeans for Identifying 
Adoption-Proneness among Vocational Teachers , 



DAVID J. OSCARSON 
Pittsburg State University 
The notion of educational change has 
often been a focal point of educational 
researchers and those responsible for 
the diffusion of educational innova- 
tions. In many cases much frustration 
has resulted due to the great degree 
of lag between the diagnosis of a need, 
for change and the actual introduc- 
tion and adoption of methods neces- 
sary for meeting the need. Despite 
the great degree of reluctance toward 
, change In our educational institu- 
tions, earlier studies by Mort and 
Cornell (1941) indicated that school 
systems exist m which there are 
teachers who are highly trained and 
^ accepting of modern educational 
* practices. 

Recently, there has been a more 
intense preoccupation with justi(y- 
ing educational change and innova- 
tion, especially since the advent of 
demand for accountability by the tax- 
payer Gross and others (1971) have 
attributed the preoccupatiori with 
educational change to a number of 
factprs. criticisms of progressive edu- 
cation that arose after World War IT. 
the efforts of schools to meet the 
demands of a rapidly changing' soci- 
ety, threats to our national defense, 
the knowledge explosion, new theo- 
retical insights into the learning pro- 
cess, and i^ore recently, the civil 
rights movement, the pressures of* 
community action groups, and ex- 
panded federal. aid to education 

Lippitt and Havelock (1968) have 
shown that it is important for those 
initiating educational change to work 
closely with the potential adopters 
or cheat system. They list four condi- 



tions necessary for the successful 
implementation of change or innova- 
tion' (1) preparatory development of 
the new competence before trying. 
(2) the demonstrated desirability of 
trying, (3) support at the critical risk 
period, and (4) adequate feedback to 
support continuity of the effort. Addi- 
tionally, it IS important to assist the 
potential adopter in defining what 
criteria will be used to measure prog- 
ress and success. 

Even though we have witnessed an 
emergence of research concerning 
educational change and innovation, 
major deficiencies still exist Often, 
results of on-going research con- 
ducted at colleges and universities 
IS not disseminated to those involved 
with the change process (Rogers. 
1965) Additionally, few studies have 
focused on the teacher as the adop- 
tion unit, despite her or his impor- 
tance in the decision making process 

Fullam (1972). m a review of exist- 
ing literature on the innovation and 
change process in schooi^ concluded 
.that most innovations were developed 
externaljy and then transmitted to 
schools In most cases, it is assumed 
by the change agent that the innova- 
tion will be accepted by the adoption 
unit. Therefore, many educational 
changes and innovations are doomed 
to failure due to a lack of concern 
and understanding of the adoption 
unit (teacher). When there is accep- 
tance of an innovation by a teacher, 
rarely is the degree of utilization 
known. 

The following pages describe a 
study in which the personal char- 

:^ . - 
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actenstics of secondary vocational 
teachers were examined in order to 
explam. at least m part, an individ- 
ual's proneness or lack of proneness 
'toward the adoption of educational 
innovations 

CONCEPTUAL FRAMEWORK 

Rogers and Shoemaker (197l! p 103) 
have conceptualized the innovation- 
decision process for individuals as a 
paradign^ith a set of four functions 
or stages tnrough which an individual 
proceeds before he or she adopts an 
idea, concept or object Briefly, the 
four stages are as follows 

Knowledge — The Individual is ex- 
posed ^to the innovation's existence 
and gams some understanding on 
how It functions 

Persuasion — The individual forms 
a favorable or unfavorable attitude 
toward the innovation 

Decision — The individual engages 
in activities which lead to a choice 
to adopt or reject the innovation 

Confirmation — The individual seeks 
reinforcement for the innovation deci- 
sion he has made, but he may reverse 
his previous decision if exposed to 
conflicting messages about the inno- 
vation 

In addition to the above stages, the 
authors point out that certain ante- 
cedent conditions- may exist before 
an individual proceeds through the 
four stages Antecedents include 
(1) the rndivldual's per3onality* char- 
acteristics, e g . her or his attitude 
toward change. (2) an individual's 
soci^ characteristics, eg, cosmo- 
politanism', and (3) the strength of 
perceived need for the innovation 

The objeotives of this study dealt 
diTrectly with testing the antecedent 
conditions of the innovation-decision 
process paradigm as conceptualized 
/by Rogers and Shoemaker In doing 
5SO, the study sought to determine if 
various, predictor variables ((the per- 
sopa\ characteristics of vocational 
teachers) explain a criterion vanable, 
proneness towards the adoption of 
education innovations. An additional 



aspect of the study concerned the 
combination of vanables, whij^h, when 
acting in concert, tended to best pre- 
dict adoption-proneness. 

PROCEDURES 
^ Sample 

The sample for this study consisted 
of 310 vocational teachers from four 
school districts within the state of 
Virgmia This sample included all vo- 
cational teachers serving within the 
four districts. In addition, these teach- 
ers represented all vocational subject 
areas tau^t in the districts (Agncul- 
ture. Business and Office, Distribu- 
tive Education, Health Occupations, 
Home Economics. Trade and Indus- 
trial Education, and Industrial Acts) 
Three of the districts consist of 
small towns interspersed with light 
industry and farming operations and 
have a -combined popuiatfon of 103 
vocational teachers. The three d^ 
tricts adjoin and come under ine 
supervision of one local vocational 
director. As a result of the above 
characteristics, Ihte-ilistricts were 
considered a homogeneous subset of 
the totaf sample selected for this 
study. 

..'"The fourth district consisted of 207 
vocational teachers from a large pub- 
lic school system In contrast to the 
other three districts, this district is 
one of the largest metropolitan school 
systems in Virginia. 

The »four districts for this study 
were selected on the basis that voca- 
tional teachers serving these districts 
were considered representative of 
all vocational teachers within the 
state of Virginia. The nc\rtheastern 
and eastern portions of Virginia are 
pnmarily. metropolitan, while the re- 
maining portions of the state can be 
considered semi-rural, with small 
and medium sized cities Scattered 
throughout. Thus, the selection of 
the four districts provided a cross 
section of the above population den- 
sities. In addition, the districts con- 
sidered ^were not under the direct 



105 



influence of the testing and experi- 
mentation by colleges and univer- 
sities within the state 

Variables 

The variable selection process for 
? this study was dictated by the con 
ceptual framework and theoretical 
constructs of the study as well as a 
review of the literature centering on 
adoption-prone individuals In one 
study, Tardanico (1974). examined 
the change receptivity of writers and 
nqn-writ^irs of occupational educa- 
tion proposals He found significant 
differences between groups when 
' x:onsidering demographic character- 
V istics His findings indicated that 
sex, years m the same school, years 
m teaching, degree level, profes- 
sional publications read, member- 
ship in professional organizations, 
mcomie^-aQd membership in non-pro- 
fessiori^^or^anizations were signifi- 
cant m^distinguishmg Change recep- 
tivity between the two groups Hood 
(1975), found positive relationships 
existed between professional comrptt- 
ment and years in teaching, years 
in the same school, ^ge, and maga- 
zines and journals used for new teach- 
ing ideas 

Research studies, such as the 
above, were influential in the selec 
tion of variables for' this study The 
disciplines of rural sociology, exten- 
sion services, marketing research, 
and various ^reas of educational re- 
search also contributed to the selec 
tion of variables. 

The independent variables chosefi, 
were as follows (1) age, (2) number 
of years in teaching, (3) level of edu- 
cational achievement, (4) recenpy Of 
professional education, (5) number. 
vOf professional publications read 
monthly, (6) membership in profes- 
sional organizations. (7) number of 
school districts in which the voca- 
tional teacher has taught. (8) number 
of years teaching in the present sch ool 
district, (9) intolerance for the ideas 
of others (dogmatism), (10) predis- 
position toward changing teaching 
rriethods, (11) personal satisfaction 



with'^ teaching. (12) the teacher's as- 
sessment of the actual influence -ex- 
erted by four sources (school board, 
superintendent, vocational teachers, 
and academic teachers) on instruct 
tional procedures, and (13) the teach- 
er s assessment of the ideafmfluence 
that should be exerted by the four 
sources on instructional procedures 

Instruments ^ 

Biographical form Information con- 
cerning the teacher's age, nunnber of 
years in teaching, level of educational 
achievement, recency of professional 
education, number of professional 
publications read monthly, member- 
ship in professionaPorganizations, 
number of school districts in which 
the vocational teacher has taught, 
and the number of years teaching in 
the present school district was ob- 
tained by utilizing a biographical 
data form Content validity for this 
instrument was established from the 
literature search based on what 
other studies have shown to be valid 
predictor variables 
The Dogmatism Scale A short ver 
sion of the Dogmatism Scale, devel 
oped by Troldahl and PoweH (1965) 
from the earlier worK of R*okeach 
(1960) was selected and used to 
measure individual tolerance for the 
ideas of others, or openness or 
closedness, and its relationship to 
adoption-proneness By means of 
the Spearman-Brown prophecy for 
mula, these authors established the 
"^ower-linnit" reliability of the 20- 
item version as being 78 Also, cross 
validation has produced a correla « 
tion of 94 between this version and 
the 40- item version reported by 
Rokeach (1960) i 

A scale to measure openness td 
change It was posited that if a teacher 
exhibited an openneiss to change, he 
or she would also derrionstrate prone- 
ness toward the adoption of new ideas 
and concepts in teach»ng. Tq deter- 
mine mean openness to change, a 
scale developed by Dohmann (1'970) 
was used in this study Basically, 
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"this scale of 10 items atte^mpts to 
measure teachers' general percep- 
tions relating to successful change 
It appears there are certain qualities 
in these perceptions, i.e.. teachers 
rely too heavily on the use of text- 
books, which characterize proneness 
to change, while other qualities do 
not facilitate an open" point of view 
Using the Kuder-Richardson 21 for- 
mula. Dohmann (1970) found a reli- 
ability of 96 when cocnputing the 
internal consistency of his original 
instrument of 45 items regarding edu- 
cational change and innovation 
S)cales to measure perceptions of 
influence A fourth section of the 
survey instrument attempted to mea- 
sure the respondents perception of 
actual and ideal influence exerted 
by four sources on her or his class- 
room procedures From this {t was 
posited that some influence /exisjs 
in the school system which may in- 
fluence a teacher's proneness toward 
the adoption of innovations This 
influence may be the result of peer 
influence or administrative policy 
The groups in question consisted of 
the school board, school superinten- 
dent, other vocational teachers, and 
academic teachers 

A scale to nieasure adoption-prone- 
ness The final portion of the instru- 
ment package consisted ^f a scale 
to measure adoption-proneness. the 
dependent variable for this study 
Adoption-proneness for this study 
was defined as an individual's per- 
ception toward the actual adoption 
of an idea, concept, or practice re- 
lating to vocational technical educa- 
tion The items were taken from^an^ 
instrument developed by fvflller (i'9^^) 
which purports to measure ohange- 
proneness with respect to the Class- 
room teacher, principal, and su- 
perintendent, The maiority of items 
concerTied the actual selection or 
adoption of innovations and educa- 
tional practices, and therefore, served 
as an ideal basis for the adoption- 
proneness scale Furthermore. Miller 
(1967) conceptualized the items on 



the basis that mental flexibility, open- 
mindedness, and curiosity are. essen- 
tial preconditions for effective 
change and/Or successful adoption 
of innovations 

Concurrent validity for this instru- 
ment was established by condbi^cting 
a correlational analysis between the 
scores attained on this instrument 
and the n5mber of ideas, practices, 
and products adopted by a group of 
40 vocational teachers A correlation 
of 44 (p . 10) indicated the inven- 
tory did provide some measure of ^ 
adoption-proneness Homogeneity ^ 
was established by correlating each. 
Item of the inventory with the total 
score for the instrument Analysis J 
revealed that all coefficients were 
positive with a range of 31 to 81 
Reliability was established by means 
of the split-half method Here, the 
Spearman-Brown Formula indicated 
a reliability .estimate of 95 for the 
17-item instrument 

Statistical Treatment 

Multiple linear regression was chosen 
as the appropriate method of analysis 
for this study Using the Maximum R? 
Improvement Technique developed 
by Goodnight (1972). each indepen- 
dent variable was analyzed for its 
contribution to the final equation 
This procedure begins by first select- 
ing the best one variable model which 
yields the greatest increase in R2 
After selecting the best one variable 
model, the technique then adds a 
second variable and so forth In order 
to obtain the best regression equa- 
tion for tfiis study, certain preselected 
criteria were also established as de- 
*wmTnfng^aetdi?^;vyhen any model, 
failed to meet any of these criteria 
It was not 'considered for the final 
analysis. The criteria established were 
as follows (1) the final model must 
have ajl F ratio significant at the 
01 level or lower. (2) no model would 
be considered unless it demonstrated 
an increase of at least 10 in the co- 
efficient of determination over a pre-* 
viously constructed model, and (3) any 
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addition of a new independent van- 
able should produce sjgnifjcance at 
the .10 levej or lower 

Assummg that all variables con- 
tributed to the regression .equation, 
the complete model would have con- 
tained nineteen predictor variables 
ar^d one criterion variable The com- 
plete model IS as follows 

Y' - a ^ biX^ + b2X2 + bsXj ^+ b4X4 
+ bsXt ^beXe + b7X7 f b^Xe v 
b9X9 ^ bioXio ^ bnXii + bi2Xi2 
fbi3Xi3 ^ buXu + bisXis ^ 
bieXie bi7Xi7 ^ biaXii 
|bi9Xi9 

where 

Y predicted score on the adop- 

tion-proneness inventory 
a the intercept constant 
bi bi9 partial regression co- 
efficients 
Xi age of the teacher 
X? - number of years m teaching 
X3 level of educational act\ieve- 
ment 

X4 recency of professional edu 
cation 

Xs number of publications read 
monthly 

Xb membership in professional 
organizations 

X? cosmopolitanism 

Xa nuQiber of years teaching m 
the present school district |' 

X^ score aUained on the-Ro- 
keach Dogmatism Scale 

Xio ~ disposition toward qhanging 
teaching methods 

Xn teacher's response toward 
finding teaching personally sat- 
isfying 

X12 actual influence exerted on 
instructional procedures by the 
school board 

Xij actual influence exerted on 
instructional procedures by the 
superintendent 

X14 actual influence exerted on 
instructional procedures by vo- 
cational teachers 

Xis ' actual influence exerted on 
instructional procedures by aca 
demic teachers 



X16 ideal influence exerted Cjn in- 
structional .procedures by the 
school board 

Xi7 - ideal influence exerted on in- 
structional procedures by the 
superintendent 

Xie ideal influence exerted on in- 
structional procedures by vo- 
cational teachers* 

X19 - Ideal jRfluence-exerted on in- 
structional [procedures by ^Cci- 
demic teachers 
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,-ln addition to the above nineteen 
independent ^variables, .additional 
factors were considered mlihe regres- 
sion model. For this study, the two 
distinct groupings of teachers, or 
the large public school system and 
the' three remaining districts had to 
be consid^red-for their effect An- 
other factor which coulc;^ have had 
some effect was teaching area, e g . 
Agriculture. Business and Office Edu- 
cation, and so forth Therefore, the 
two geographical locations and seven 
teaching areas were considered as 
" dummy variables'" ifi the analysis 

FINDINGS 

Survey^nstruments were mailed to 
310 vocational teachers in the four 
districts previously described Two 
weeks after the initial mailing, follow- 
up letters were sent to the teachers 
to encourage further responses After 
follow-up activities were completed. 
^208 instruments were completed and 
returned to the investigator From this 
number. 202 instruments were consid- 
ered usable, giving an overall re- 
sponse rate of 65 percent. 

The only difference noted between 
respondents and non-respondents 
Vvas that more non-respondents were 
members of the large public school 
system This'did not create concern, 
as the actual difference between this 
district and the others amounted to 
only 8 percent 

Regression Analysis 

The Maximum Improvement Tech 
nique final regression model em- 
ployed five predictor {independeA<) 
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variables In explaining the crite- 
rion variable-adoption-proneness The 
model includfe.d whether or not a 
teacher taiind teaching personally 
satisfying, the number of profes- 
sional publications read monthly, 
age. the ideal influence a vocational 
teacher felt should be exerted on 
instructibnal procedures by academic 
teachers, and the number of years 
spent teaching in the present school 
district Regression analysis for 
these variables can b^^found in 
Table 1 - • 

Mathematically, this model can be 
expressed as follows 

Y' = 55.712 = 2l3Xi + 1.276X5 - 
244X8 + 3 213X11 + 1 269Xi9 

where 

* Y' =^ predictedsscore of the depen- 
<ient variabl^adoption-prone- 
\ ness 

55 712 - the intercept constant 
. ' Xi = age 

Xs - number of publications read 
mdnthly 

Xe ^ number of years teaching in 
present school district 

Xii ^teacher's respons€ toward 
finding teaching personelly s^t-' 
isfying \ 

Xi9 - ideal influence exerte^ dn in-» 
structional procedures by aca- 
demic teachers 

« 

As noted in Table 1, four partial re- 
gression coefficients {b values) are 
positive with the exception of that 
for the number of years spent teach- 
ing in the present scjnool district. It 
appears that those teachers who had 
spent less time in their present school 
districts tended to be more adoption- 
prone than their counterparts. 

Mean Scores of Variables 

The criterion and independent vari- 
able mean scores and standard de- ^ 
viations for the districts and total 
sample are provided in Table 2. The 
score for. variable 11 was based on 
a sir]gle response to a statement in 
the Likert format which asked the 
respondent to indicate the agreement 



or disagreement he or she felt to- 
ward finding teaching personally 
satisfying. A 3Core of 1 indicated 
strong disagreernent toward finding 
teaching personally satisfying, while^ 
a score of 6 indicated strong agree- 
ment A respondent's score for vari- 
able 19 (the ideal influence exerted 
on instructional procedures by aca- 
demic teachers) was based on a con- 
tinuum which ranged from 1 (little 
or no influence) to & (a very great 
deal of influence). A score for the 
criterion variable was established 
by summing eaoh of the 1 7 responses 
on the adoption-proneness inventory. 
Possible scores could have ^ranged 
from a low of 17 to a high score* of 
119. All remaining scores for signifi- 
cant independent variables were taken 
directly from survey instruments. 

Product Motnent Correlation 

A product-moment (zero order) cor- 
relation coefficient was calculated 
for each pair of numeric variables 
(all independent variables , and the 
dependent variable), including the 
probability of significance. A number 
of these correlations were significant 
at the .05 level and some were signifi- 
cant at the .01 jevel (see Table 3). 
InfercorrelationsVanged from -.288 
to .925 'Table 3 presents the corre- 
lation coefficients and their signifi- 
cance for the five significant inde- 
pendent vaFlables and the criterion 
variable. 

The results of this study appear to 
suggest that certain menial, physi- 
cal and professional attributes exist 
among vocational teachers as deter- 
minants in explaining their prone- 
nes% toward adopting educational 
innovations. The following sections 
discuss evidence in support of the 
findings in this study. 

Age 

Results of the study indicated that 
age was positively correlated with 
the criterion variable adoption-prone- 
ness in that older teachers tended to 
score higher on the adoption-prone- 
ness inventory. 
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Source 

Regression 

Error 

Corrected Total 

Source 
Satisfaction 
Publications 
Age 

Ideal Academic 
Teacher Influence 

Years Teaching in 
Present District 

Source 
Mean 

Satisfaction 
Publications 
Age ^ 

Ideal Academic 
Teacher Influence 

Years Teaching m 
Present District 



Reg 



ression Analyst 
and the Depe{}i 



TABLE 1 

between Five Independent Variables* 
nt Variable Adoption-Proneness 



DF 
5 

*190 
195 

DF 
1 
1 
1 

1 

1 

B Values 
55.7121 
3.2139 
1 2762 
02131 

96 

-0 2442 



Sum of Squares 
5013.893 
17695.923 
22709.816 

Se^entiat SS 
2663.183 
1476 631 t 
311.991 

274.738 

287.348 
T for HO B = Q 

4.17 
3 36 
2.50 

1 89 

-1.75 



Mean Square 
1002.778 
93 136 



0.0002 
0.0013 
0.0126 

•0 0563 

0 0768 



F Value 
10 76 



Prob >V 
0.0001 



R-Square 
0.2207 



F Value 
28,59 
15.85 
3.34 


P/ob > F 
0.0001 
0 0003 ^ 
0.0652 


Partial SS 
1621 059 
1057.055 
583.781 


F Value 
. 17.40 
, 1 1 .34 
6 26 


Prob > F 
0.0002 
0.0013 
0.0126 


2.94 


0.0836 , 


334.494 


3.59 


0 0563 


3.08 


0.0768 


287 348 


3.08 


0 0768 


Prob > |T| 


Std Error B 




% 





0.770 
0 378 
0.084 

0 669 

0 139 



' Satisfaction Age Publications, Ideal Academic Teacher Influence. Years Teaching in Present School District 

r 
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^ TABLE 2 

Means and Standard Deviations for thef Five Independent and 
One Crtterton Variable by District and TotaJ. Sample 



Districts A, * 

B, and C District D Total 



1 Age , 

5. Professional Publications 
Read 

8 Number of Years Teaching 

m Present School District 
11 Response Tov^ard Finding 

Teaching Personally 

Satisfying 
19. Ideal Influence Exerted 

by Academic Teachers 
20 Adoption Proneness 

(Criterion Variable) 



JN = 
X 


78) 
SD 


(N = 
X 


124) 
SD 


X 


202) 
SD 


38.35 


11 93 


38.73 


10 86 


38.58 


11.26 


2 75 


1 56 


3.21 


2 08 


3.03 


1 91 


8.98 


713 


8.65 


6 56' 


8.78 


6 77 


5.12 


0 69 - 


5 01 


1 04 


5.05 


0 92 


2.27 


0 94 


2.65 


1 00 


2 51 


1.06 


85.05 


10 25 


85.23 


11 29 


85.16 


10 88 



TABLE 3 

Product-Moment Correlations among' Six Variables 
Used in the Study (N 202) 







1 5 8 


11 


19 


20 


1 


Age 


1 23* 67* 


17- 


51- 


22- 


5 


Professional Publications 












Read 


1 2r- 


17- 


14-- 


31- 


8 


Number of Years Teaching 












in F^resent School District, 


1 


06 


13 


07- 


11 


Response Toward Finding 








Teaching Personally 












Satisfying 




a « 
1 


00 


34* 


19 


Ideal Influence Exerted 










by Academic Teachers 






1 


14- 


20 


Adoption-Proneness 












(Criterion Variable) 








1 


* P 


^ 01 


> 
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Rogers and Shoemaker (1971, p 
352-354) found inconsistencies existed 
in the evidence presented between 
the relationship of age and Innova- 
tlveness Nearly 48 percent of the 228 
studies they reviewed demonstrated 
no relationship, 19 peVcent showed 
that earlier adopters are younger, 
and 33 percent indicated they are 
older. 

One possible explanation for the 
positive correlation found in this 
study might be the fact that as voca* 



tional teachers grow older they be- 
come more knov^/ledgeable about their 
respective teaching areas and tend 
to seek out innovations which assist 
or improve on their instructional prac- 
tices. Additionally, the study indi- 
cated that the mean age of the re- 
spondents was 35.58 years. From this 
one might speculate that many of the 
teachers were quite possibly selected 
for their present positions from the 
ranks of various industry or trade 
grbups. As a result, they may have 




III 



106 



been exposed to variou,a^ p/actices 
and techniques before enle'hdg the 
teaching profession. , ' 

Another plausible explanation may 
simply be a measure of the accumu- 
lation of certain practices over time, 
i e . the older teachers beicome. the 
more time they have to adopt various 
practices Younger teachers^ obvi- 
ously have had less 'time to l§arh 
about, experiment with, and adopt 
a largfe number of innovative prac- 
tices 

Professional Publications Read Monthly 

Analysis revealed, that the number 
of professional pubTications read 
monthly correlated positivelyt with a 
respondent s score on the adgption- 
proneness inventory Others have 
found that those who read "more lit- 
erature and are more active in seek- 
ing of information tended to select 
and adopt more inno\/ation^ than 
those who do not engage m such 
activities (Christiansen & Taylor, 1966; 
Averill. 1967; Lionberger I960. Ver- 
ner & Gubbels, 1967) Rogers and 
Shoemaker (1971) also found earlier 
adopters tended to seek more infor- 
mation*about innovations 

Numbef of Years Teaching in 
the Present School District 

An inverse relationship existed be- 
tween number of years teiiching m 
the present school district and a re- 
spondent's .score on the adoptton- 
proneness inventory. This appears to 
be in agreement with the findings of 
Rog^ers and Shoemaker (1571), and 
Carlson (1965) These authors found 
that persons who vyere more likely 
to accept and use innovative prac- 
tices exhibited traits of both social 
and geographical mobilTty and lacked 
tenure m their present positions. 
Quite possibly, many of the individ- 
uals in this study were drawn from 
business and industry, explaining 
limited time spent in the teaching 
profession Another explanation could 
be that they changed schools more 
frequently than non-adopters. 
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Response toward Finding Teaching 
Personally Satisfying 

Analysis revealed that those who 
scored higher on the adoption-prone- 
ness inventory tended to find teach- 
ing highly satisfying. This variable 
was alsa the first to enter into the 
regression equation, thereby contrib- 
uting the maximum-explained vari- 
ance. 

In synthesizing their clinical and 
statistical analysis concerning inno- 
vations, Rogers and Shoemaker (1971) 
described the innovator or earlier 
adopter as being highly satisfied with 
her or his vvork, resulting in increased 
productivity through Ihe use of in- 
novations. ^ 

Ideal Influence Exerted 
by Academic Teachers 

The final variable to enter the re- 
gression equation related to the ideal 
influence vocational teachers felt 
should be exerted on her or his class- 
room procedures by academic teach- 
ers This vanable correlated positively 
with the criterion variable, therefore. 
It appears that vocational teachers 
who are more adoption-prone desire 
more interaction with academic teach- 
ers and even consider ^he academic 
teacher a peer. Ross (1958), support- 
ing this notion, found that contact 
among teachers was considered an 
important source for ideas concern- 
ing innovation and change. 

DISCUSSION 

Certain cautions are in order concern- 
ing the use of multiple linear regres- 
sions as«a means for arriving at use- 
ful predictor equations for studies 
similar to this one. The rather low 
coefficient of determ*ination, (ex; 
plained variance) in this study attests 
to this fact. Yet, the findings seem^to 
have utility for Identification pf vo- 
cational teachers m the adoption pVo- 
cess. The significant predictor vari- 
ables appear to be more descriptive 
or analytical. Therefore, one might 
Identify adoptlon-proneness by an 
individual's score on the adoption- 
proneness inventory. 
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Synthesis^ 

This portion of the vocational curriculum and instruction research sec- 
' tion serves to point out certain aspects of the example studies and pro- 

vide further direction for research in the area. As one might imagine, iden- 

tifying relatively homogenous studies is virtually impossible The 
, reader will thus find It necessary to make appropriate cognitive leaps 

from one stud/ to another^ drawing a^ necessary from the research 

review at the beginning of this section. 

O'NEIL AND NELSON STUDY 

0 Neil and Nelson focus their research on a critical aspect of curriculum 
content, occupational survival skills. The authors begin by indicating 
that a person typically makes several career c^ifanges during his or her 
working years. They note that identification of a common core of skills 
would-TDermit programs to be established which aid in worker survival 
Several methodological considerations in the study ar^ worthy of note 
First, a telephone survey inst/ument was utilized to gather data in an 
accurate and expeditious manner. Secondly, data were gathered. from 
a random sample of workers representing the general population 
While these approaches have certain inherent limitations, they appear 
most appropriate for the kinds of data which were needed. 

Results revealed that eleven of the skills were rated as very important 
for job maintenance by at least 50 percent of the total respondents 
Discriminant analysis results were of even greater importance since 
they revealed the contributions skills made \<T maximum separation 
of occupational groups. In this instance, ther^ appeared to be seven- 
teen skills which did not contribute appreciably to any significant 
differences. 

This study reflects the type of fresh and creative exploratory effort 
which IS necessary if we are to deal properly with complex curriculum 
content. In addition to searching fpr non-technical employment skills 
(a most difficult task in and of itself), the authors chose to utilize sta- 
tistical analyses which focused on the multidimensional aspJects and 
perceptions of work. The use of relevant statistical techniques such 
as discriminant analysis should aid us greatly in the continued study 
of vocational education curriculum content. 

STEWART. LASH, AND KAZANAS STUDY 

The stud^ conducted by Stewart, Lash, and Kazanas examined principle 
learnihg in a vocational setting. Early on, the authors note a need to 
^ meet individual students' learning needs ancTthe failure of teachers to 
provide, for learning* style differences, particularly as these differences 
are associated with verbal ability. This investigation not only examined 
effects due to treatments (different verbal formats) but also took ability 
levels (reading ability) into account. Benefits gained by such a design 
are obvious, results may point to differential effects across ability 
levels which would have greater implications for instructional design 
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Experimental research in applied settings is most difficult to con- 
duct The investigators rose to meet this cfiallenge, utilizing students 
m an area occupational school and following appropriate procedures 
for randomization of subjects* Results revealed several significant 
differences between groups, however, a lack of consistency in findings 
emerged. This situation occurs quite often in applied research and is 
a problem with which any investigator should be prepared to deal. The 
authors discussed the results in detail and provided plausible explana- 
tions of why certain inconsistencies may have occurred. The design of 
this study (treatments by level?) provided a more meaningful base for 
discussion, giving the reader greater insight into what may have taken 
place If the investigators had chojsen only to examine treatments, the 
explanation process vs^ould have been much more difficult^to carry out. 

KIZER AND SCRUGGS STU6y 

When a persistent problem exists in education, a re^archer is some- 
times better off exploring certain phenomena asso^rted-.with it and 
using results as a basis for planning further research/libe^iie between 
teacher behavior and studertt achievement is clearly one\)f thesie prob- 
lems and perhaps represents an ultimate challenge toVrei&^rchers. 
Kizer and Scruggs managed to deal with this problem systenrraticaHy, 
using a conceptual model as a basis for their investigation. Because 
of its ex post-facto nature, this study necessitated the establishment of 
very precise data gathering procedures. Irrstruments needed to be 
sensitive enough to a^ess variation among teachers as welt as among 
^ students. ^ 
Whil^ the results may appear to lack specificity, it should be noted 
that there were no hypotheses or research questions" associated with' , 
the study When more fundamental research is initialed in a particular 
area, being less specific may aid in determining what various processes 
consist of. thus contributing to the formulation of hypotheses in later 
studies Since results tende^d to support the notion that relationships 
exist between teacher behavior and student achievement, researx^hers 
may feel more confident about using larger, more cumbersome samples 
ctnd developing more sophisticated instrumentation. ^When pursued 
wisely, exploratory research efforts make a most-meaningful contribu- 
tion to our knowledge about instruction and learnm^. 

OSCARSON STUDY 

The study reported by Oscarson focused on^^w area that many re-^ 
searchers have ignored the adoption of innovations in education. 
The author first cites a need to explore th^^rea, particularly since 
many innovations are placed in schools without any 'knowledge of 
how they are accepted or rejected. Rogers and Shoemaker's innova- 
tion-decision process paradigm served as a conceptual framework 
for the study, however, the investigator elected to specifically test the 
antecedent conditions of this paradigm. Variables were selected ba^ed 
upon results of related studies. Instruments associated with th.ese 
variables represented an interesting mix. Some instruments were al- 
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ready available while others needed to be validated ty the investi- 
gator. This situation is often the case when a researcher builds a study 
from a theoretical or conceptual base. 

Multiple linear regression (MLR) was utilized to account for the 19 
independent '^^ariatyes, and nine concomitant v.ariables (geographical 
areas and teaching areas). There is clearly a benefit which c6n accrue 
for thet^nvestigator using MLR. By partialing out the effects of certain 
variables, relationships may t)e more sharply defined. 

Results suggfest that certain of aXteacher's personal characteristics, 
serve as determinants in explaining proneness tQvyard adopting edu- 
cational innovations. It may be noted that results ate woven batk into 
previously conducted^ research, thus serving as a bridge to Vunda- 
mental knowledge about the area. This process can be extremely 
valuable since it aids in clarifying relationships among variables. 

IMAGES OF THE FUTURE 

Perhaps the past and present can tell us something about the future. 
It is reasonably clear that past research efforts in vocational curricu- 
lum and instruction have tended to consist of separate problematic 
activities. And, while some of^the more receni research has shifted 
away from a problematic mode» the number of researchers engaged 
In long term efforts is indeed small. 

As Pratzner and Walker (1972) poirft out, progr^ammatic research 
"is a ratipnal means for effectively allocating scarce resources toward 
the reduction of persistent educational problems." Certainly, program- 
matic researph cannot solve all of our problems, however, it may easily 
serve as a focal point when solutions are sought to complex problems. 
Even though the use of programmatic research requires long range 
planning, financial support and personal commitment, it appears to 
bfe a needed part of our future research agenda. While the past looks 
rather bleak and the present does not appear to be a great deal better 
except perhaps jn the curriculum content area, our future will be 
greatly influenced by the extent to which systematic, programmatic 
research' activities are conducted. Hopefully, both researchers and 
funding will be available to carry on needed research studies in voca- 
tional curriculum and instruction. It is only in this manner that we can 
meet the challenges of the futufe. 

SYNTHESIS REFERENCE 
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' Research Review 

INTRODUCTION 

The design and delivery of career development programs for special 
needs populations continues to be an emerging national priority for 
the education and employment communities. The critical need for 
viable vocati6nal and career education programming for the handi- 
capped, minorities, the disadvantaged, limited English speaking popu- 
lations, and other special needs groups fias been reflected in numerous 
pieces of federal legislation since the early 1960's. The Vocational 
Education Amendments of 1976. as well as Public Law 94-142. Sections 
503 and 504 of the Rehabilitation Act of 1973, and the Comprehensive 
Employment and Training Act of 1978, speak to the need for these popu- 
lations to have full access to appropriate training programs that will 
lead to productive, meaningful, and satisfying employment. While ^ 
the proliferation of mandates has been rapid, the actual development, 
or expansion of programs has occurred at a less rapid rate As this 
review will substantiate, the restricted rate of development and expan- 
sion of programs is due. to a large extent, to fragni^nted and limited 
research, development, and dissemination efforts. Certainly, one of 
'the major purposes pf research and development programs is to ex- 
pand Ibe capability of practitioners to respond to^new and emerging 
trends in the field (e.g., the mainstreaming of special needs students 
into regular vocational classes). The extent to which this has occurred 
in this prionty area has been influenced by a number of factors Thd 
factors include, but are not necessarily limited to. (1) limited research 
funding, (2) poor^and limited research dissemination efforts, i3) insuf- 
ficient attention by vocational education researchers to t|je 'need for 
research m this priority area. (4) lack of baseline, needs assessment 
studies to determine the most significant problems requiring research, 
(5) poor or nonexistent research designs for eArly res^&rch and develop- 
'ment efforts, and (6) failure to integrate and build upon research in 
related disciplines, most notably the fields of vocational rehabilita- 
tion and special-education. 

This review of research related to vocational education for special 
needs populations has several purposes. First, it fJrovides a compre- 
hensive overview from which future annual reviews can examine spe- 
cific issues or specific special needs populations. It also serves as a 
benchmark from which the field can measure the progress of program- 
ming and research into the 1980*s. An additional thrust is to identify 
and stimulate research and. program improvement activities in areas 
of critical need. Finally, the review seeks to assist individual research- 
ers, as well as administrators of research and development programs 
at the local, state, university, and federal levels to plan and articulate 
their research efforts in this area. 

At the outset, it is important that the parameters of the review be 
identified. Approximately 100, research abstracts, articles, and prod- 
ucts were reviewed. The search was limited to research dealing with 
vocational education and career education programs as they are deiP 
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fined jn federal legislation, i.e. P.L 94-482 and P,L. 95-207 respectively. 
Research was reviewed which focused on the handicapped, disadvan- 
taged, and limited English speaking populations. Reviews focusing 
on women and CETA-eligible clients, which frequently are also con- 
sidered special populations, are presented in other sections of this 
volume. 

For purposes of this review, research was broadly defined. Research 
was operationally defined to encompass a number of activities that 
have as a common goal the improvement of vocational progi^ms for 
special needs populations. Reports and products from rese/rch and 
development projects, curridulum and program development SKtivities, 
innovative, exemplary, and demonstration grants, and teacher' 
projects were reviewed. Thus, a diverse set of perspectives and diff€ 
ing types of studies are reflected herein. ^ 

REVIEW OF RESEARCH: 1975-79 f 

The prepar^ajtidn of a comprehensive literature review on vocational 
education research for special needs populations is a monumental 
charge. Indeed, if done adequately, the r'eview could fill several vol- 
umes Gjven the limited space and the comprehensive nature of the 
studies selected for the review, the section editor chose to address, 
in a rather cursory manner, four major special populations. The follow- 
ing section^s will afcquaint the reader with a sampling of major re'^search 
and development projects that have targeted upon improving voca- 
tfonal education for limited English" speaking, handicapped, incar- 
cerated, and disadvantaged learners. 

Research on Vocational Education for Limited English Speaking Learners 

The projects reviewed in this section focuS predominantly on bilingual 
instructof training and adoption of vocational curriculum materials 
fpr the Irmited English speaking students. Here, as with other special 
needs,populations,.^he overriding concerns appear to address teach- 
ing materials and the preparation o^ instructors to accommodate the 
limited English speaking student. 

Smith (t976) produced a "production-ready, basic prevocational 
course in English-as-a-second-language using an audio-Visual format. 
The course, which also includes teacher materials, can be used with 
persons fnom any home-language. 

Cohen (1976) assessed the career aspir^ation and self-congruence 
of Puerto Rican youth through the use of stancjardized instruments. 
The results were used to devebp a pilot career awareness/orientation 
curriculum for use in bilingual schoolrooms in Connecticut. 

Clark (1976) conducted a study that examined the effect of Spanish- 
English bilingudlism on the acquisition, retention, and transfer of 
vocational concepts for students enrolled in vocational ^education 
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Todd (1976) developed a prototypic model for modifying and adapt- 
ing existing vocational education curriculum materials for use with 
students of limited English speaking ability. A Modular Procedural 
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Guide was develope'd for use by vocational and bilingual curricMlum 
specialists in the modifipation of materials. 

Ellis (1976) has completed a project which includes a series of bi- 
lingual metric education modules for use in post-sacondary and adglt 
vocational education programs. 

Beaudoin (1976) conducted a project to design and develop bilin- 
gu^l/bicultural instructional^ materials (French-American) for the hu- 
man service occupations in Vermont. A state-wide dissemination of 
the materials was conducted. 

Brady (1978) conducted a major project examining bilingual voca- 
tional education instructor competencies. A monograph .was pre- 
p^lred outlining the minimum competencies needed by instructors in ^ 
bilingual vocational training programs. In addition, a criterion-refer- 
enced test for competency assessment was developed. Four national 
dissemination workshops were held in various regions of the natidn. 

Galvan, Ramey and Gonzalez (1978) have cdmpleted the initial phase 
of a development test of English proficiency for adults of limited En-' 
glish speaking abilities. The project focuses on the development of a 
comprehensive vocational contextual basis for the adult participant • 
in bilingual vocational training programs and produced a test with 
two equivalent forms to measure the participant's proficiency of lan- 
guage skills used in the English-sqeaking working environment. 

The Bureau of Occupational and' Adult Education, U.S, Office of 
Education annually funds several bilingual vocational edjucation pro- 
grams and bilingual vocational instructor training programs. Some 14 
projects in seven different states were fundejd during FY 1978. Training 
for students and instructors was provided for such languages as Span- 
ish. Vietnamese, Chinese, Filipino, and various dialects of American 
Indian. Most of the projects emphasized training in entry level occupa- 
tions in such fields as construction, dental- assisting, foods service, 
plastics, clerical/secretarial, auto mechanics, and accounting. Since 
the program^ were focused on training and instructor training exclu- 
sively, research products were not generated. However, the existence 
\)f such programs provides a significant opportunity for pursuing a 
broad range of research questions related to vocational instruction 
of the student with limited English speaktng ability. 

Research on Vocational Education for Handicapped Learners \ 

Most of the studies reviewed on handicapped students focused ori^ 
mainstreaming concerns. Several projects were qoncerned with the 
. identifi(>ation of barriers and the subsequent development of media 
and inservice materials to aid vocational educators in overcorning 
the identitied barriers. Most projects addressed teacher concerns and 
interventions while a fewer number of projects addressed teacher and 
adrhinistrator concerns. 

Nystrom (1976) has completed a project to analyze existing barriers, 
forecast potential problem areas, and prescribe professional develop- 
ment solutions. to mainstreaming handicapped students into voca- 
tional education programs. A set of instructional modules on effec- 
tive mainstreaming strategies was prepared for use tjy special and 
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vocationaf education administrators, guidance personnel, and teachers . 

Kaufman (1976) has conducted a project to examine the labor market 
effects of occupational education programs for the physically handi- 
capped. The study exanruned the availability and utilization of secon- 
dary school occupational education programs and the costs of alter- 
native programs and their effectiveness, in terms of the labor market 
e;<periences of the' prog ram graduated. 

Costello (1976) has conducted a project to assess the vocational 
potential of hearing impaired mentally retarded individuals in a variety 
of institutional and community settings. An instrument (the Rehabili- 
tative Skill Inventory) was developed and validated as a part of the 
research. 

Shill (1976) has completed a research project to develop and test 
criteria for the identification and selection of mentally handicrf^ped 
students for vocational programs. The criteria are applicable for en- 
rolling students in "special vocational education programs" and for 
allowing sejected mentally handicapped students to enroll in regular 
vocational education programs. 

Fowler and Schwartz (1976) have developed a set of self instructional 
booklets for changing the attitudes and procedures of educators and 
administrat6rs in regard to integrating h^andicapped students into 
vocational education programs. 

Tindall (1978) has completed a project to formulate goals and pro- 
cedures for analyzing, revising, and developing vocational education 
programs for the handicapped in Wisconsin's 16 VIAE districts during 
1977-82. 

Hughes (1976) has recently finalized a project in North Carolina to 
identify needs and barriers to mainstreaming as expressed by occu- 
pational education personnel who occupy key roles with respect to 
implementation of the "least restrictive environment" concept A set 
of policy recommendations was formulated. 

Abe^On and^ Davis (1976) have completed the development and dis- 
semrnation of &ry administrative policy manual for vocational education 
of the handicapRed, The manual contains exemplary and suggested 
policies for local education agencies regarding the provision of appro- 
priate vocational education sevices to all handicapped children. 

Dahl, Appleby and Lipe (1976) have prepared a practical guidebook 
for vocational educators to assist them in identifying and overcoming 
the barriers to mainstreaming. 

The Contract Research Corporation has recently completed a proj- 
ect to develop tools (a user's' guide and training package) needed by 
vocational educators in order to develop individual education plans 
(lEPs) for handicapped students As a part of the project, training was 
provided to state level personnel for their use in vocational educa- 
tion, special education, vocational rehabilitation^, guidance and coun- 
seling, and CETA programs. 

Smith (1978) has completed the development of a media prtisyiild- — 
tion (film) on mainstreaming of the handicapped in secondary voca- 
tional education programs under a contract with the Bureau of Occu- 
pational and^ Adult Education. ^ / 
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Rice (1978J is presently engaged in the development and validation 
of a planning process for improving the accessibility to vocational edu- 
_ _ cation-ptograms and_fadlitieSL_tQt.hariclicappacl„pjea:sons at the local 
education agency level. A training package, including a media presen- 
tation fqr local administrators, is also under develbpment. 

POpe^nd Kienast (.157^)^have recently completed a project to im- 
prove the vocational irfstructional delivery system for handicapped 
individuals/The project identified those competencies and knowlege 
required of vocational educators to instruct handicapped learners. 

Research on Vocational Education In Correctrons 

A number of national and state level exploratory studies have been 
funded to examine vocational needs and training programs in correc- 
. tional settirxgs. Several of the projects are focused on female and 
youth offenders. 

Kaufman (1976) has completed a study of the quality and results of 
vocational education *n correctional institutions. Among the factors 
evaluated in the multi-institution study were. (1) quality of the voca- 
tional program. (2) level of skill attainment of program participants, 
and (3) the educational climate of the institution. 

Pershing (1976) has formulated a comprehensive master plan for 
vocational education in the correctional institutions of Missouri. 
Drewes (1976) has developed a procedure and related instrumentation 
for assessing correctional vocational, education needs in Nor<h Caro- 
lina. Nuttall (1976) conducted a similar study for youth under the 
custody of the Massachusetts Department of Youth Services. 

In a project conducted at Virginia Polytechnic Institute and State 
University. Looney (1976) has formulated a model curricula and proto- 
type instructional materials for use in upgrading the occupational 
skills of adult women offenders. 

Rice (1978) has conducted a state-of-the-art assessment of voca- 
tional education programs in correctional institutions m D.JH.E.W. 
Region IV. The critical characteristics of vocational education pro- 
gramming provided in all juvenile and adult pJblic correctional facili- 
ties were identified. In addition, innovative procedures/techniques/ 
practices were described. 

Whitson (1976) at The National Center for Research in Vocational 
Education, The Ohio State University, condu<sted a comprehensive 
study of vocational education in corrections. The study focused on 
the development of a set of standards for program design, operation, 
and outcome evaluation. A national survey of programs was conducted 
to identify major needs, problems, and issues* 

Wiederanders (1976) assessed the "job survival skills" of youthful 
offenders and developed a modularized curriculum to meet the identi- 
fied needs The job survival skills of both paroled and incarcerated 
youth were studied. 

Jenkins (1978) is currently involved in a project examining the needs 
of women offenders. The project, to be completed in March, 1980, will 
review the vocational programs for women offenders within st^te and 
community-based correctional systems, anfl^ identify and document 
successful vocationallraining programs. 

Er|c - ■ 122 ' 



Research on Vocational Education for Disadvantaged Learners 

A review c4 the vocational education research literature rtotes only two 
recent studies on vocational education for the disadvantaged Since 
the early 1970's it appears that the disadvantaged population, as a 
research and program improvennlent priority in vocational education, 
has dropped tron;i the scene at the state and national level. This is some- 
what perplexing if one carefully studies the national assessment study 
of vocational education programs for the disadvantaged, which is 
reviewed in def*h in the following section. There are a number of 
major, recurring problems associated with the delivery of vocational 
education to the academically and economically disadvantaged A 
partial answer to the paucity of research undertaken by the vocational 
education community is attributable to the growth of CETA programs 
Increasingly, employment and training programs are attempting to 
serve in-school and out-of-school economically disadvantaged youth 
Numerous CETA-vocational education linkage activities have been 
initiated at the local, state, and national levels. 

Farmer (n.d.) surveyed 240 vocational administrators and teachers 
m several large cities in Pennsylvania to determine some pedagogical 
competencies that met the needs of inner-city disadvantaged youth 
The m^jor recommendations of the study included. (1) the conduct 
of more preservice and inservice workshops, conferences, and semi- 
nars concerning the diverse cultural and socioeconomic backgrounds 
of students m order to improve the effectiveness of inner-city teachers, 
(2) increased recruitment of minorities for administrative and teaching 
positions in vocational education, and (3) the inclusion of more inter- 
disciplinary content in teacher education programs related to issues 
dealing with the disadvantaged. 

Wircenski (1978) completed a major state-wide project in Pennsyl- 
vania focused on meeting the needs of vocational teachers of the disad- 
vantaged. The objectives of the project included. (1) determining the 
state-of-the-art in vocational education programming for the disadvan- 
taged in Pennsylvania and nationally, and (2) developing materials that 
would aid in improving vocational programs for the disadvantaged.' 
Three products were developed and tested. (1) a curriculum guide for 
work related skills, (2) a system for the identification and assessment 
of disadvantaged students, and (3) an instructor profile to^ aid in the 
selejDtion and development of staff. 

Research on Vocational Education for Special Needs Learners 

Some researchers have chosen to examine the delivery of vocational 
education to special populations from a comprehensive perspective, 
that IS. to consider several •special groups collectively as a group of 
learners or students with "special needs." 

Albright. Evans and Fabac (1978) developed and tested. a system for 
the identification, assessment, and evaluation of special needs le^rn- 
ers in vocational education programs. A series of nine guides were 
prepared for vocational teachers and administrators to use in imple- 
menting an assessment and evaluation system for special needs 
students. 
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Phelps (1976) conducted a formative field test evaluation of seven 
inservice teacher education modules. The modules were designed 
for use by teams of vocational and special educators, and provided 
, a system for developing, implementing, and evaluating instruction for 
the special needs learner. 

Maiek (1978) is completing a project at The National Center for Re- 
, search in Vocational Education, The Ohio State University entitled 
"Responsive Vocational Education for Special Needs Populations. " 
The project is designed to train teachers, counselors, and adminis- 
trators to recognize and respond effectively to special needs. A set of 
descriptive texts and technical bnefs are being developed that de- 
scribe the priority common and unique needs of special needs- popu- 
lations, including the gifted and talented, handicapped, bilingual, 
prisoners, migrants, and minorities. 

Drewes, Heath, Katz, Spetz, and Thomas-Gordon (1979) are involved 
in the design and development of a comprehensive planning system 
for states to use in selecting planning strategies for providing voca- 
tional education to special populations. The major tasks for the plan- 
ning system are structured around the federal Management Evaluation 
Review for Compliance Quality procedure used by the U.S. Office of 
Education 

OVERVIEW OF FOUR LIGHTHOUSE STUDIES 

Thacompanion studies conducted by the Olympus Research Corpora- 
tion in 1974 and 1976 e^camine the status of programming on a national 
scale for the handicapped and disadvantaged Both studies examined 
policies, programs, and services at the state, local, and project level. 
At the state level, the variables studied included, management informa- 
tion systems, organizational factors, interagency relationships, plan- 
.ning, funding, and evaluation. At the local school district and/or project 
level, factors such as enrollment characteristics and trends, planning 
and administration, work experience program components, student 
selection practices, and instructional offerings were studied. 

The Iowa Vocational Education/Special Needs Assessment Study 
involved mail survey ' responses from 1,265 vocational education in- 
structors in the state at the secondary level. The principal purpose of 
the study was to determine the extent to which services were being pro- 
vided to disadvantaged and handicapped students in vocational classes 
and the areas of support which need attention. The results of the study 
were used in the administration of programming reflected in the Iowa 
State Plan for the Administration of Vocational Education Among 
the major factors examined in the study were professional back- 
grounds and attitudes of instructors, services available to special 
needs students, class enrollmeot data, and identification of problem 
areas and suggested solutions. 

The fourth state-of-the-art study was commissioned by the Minne- 
sota State Legislature in 1977 for the purpose Of determining future 
program needs for services to handicapped or disadvantaged students 
in vocational-technical education. This, also, was a state-wide needs 
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assessment study. However, only existing data we're used to provide 
the, best possible description of the present need for services to special 
needs individuals who could benefit from vocational education. More 
specifically, the objectives of the study were to. (1) define and specify 
identification criteria, (2) estimate the prevalence of persons who are 
handicapped and disadvantaged, (3) list and describe the present ser- 
vices being provided, and (4) identify the sources and relative alloca- 
tions of federal and state funds used to support special needs indi- 
viduals in vocational-technical education programs 
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Aq^ Assessment of Vocational Education Programs 

for the Disadvantaged under ttie 1968 Amendments ^ 

to the Vocational Education Act: A Summary 



JOHN WALSH and 
JAN L TOTTEN 
Olympus Research 
Corporation 

BACKGROUND 

>^ Six years after the passage of the 
Vocational Education Act Amend- 
ments of 1968, the Office of Planning, 
Budgeting, and Evaluation of the U.S. 
Office of Education contracted with 
Olympus Research Centers (ORG) to 
perform a nation-wide assessment of 
the Act's provisions that deal with 
vocational education programs and 
services for the disadvantaged, or 
". . ^ persons (other than handicapped 
persons) who have academic, socio- 
economic, or other handicaps that 
prevent them from succeeding in the 
regular vocational education pro- 
gram " Part B of the Act, which re- 
Qtiires state and local matching of 
federal funds, provides that 15 per- 
cent of basic grants to the states be 
used for the provision of vocational 
education programs and services to 
the disadvantaged, and Part A, Sec- 
tion 102(b) provides 100 percent 
funding of vocational education pro- 
grams for the disadvantaged. 

PURPOSES OF THE ASSESSMENT 

, The purposes of the assessment, as 
' specified by the U.S. Office of Edu- 
cation, were as follows: 

(1) To provide information about 
how the state^ set priorities and allo- 
cate funds for vocational education 
services and programs for disadvan- 

* taged students 

(2) To identify and analyze the vari- 
ous policies, decisions, or s.trategiQ$ 



within the community setting, such 
as coordination of resources for the 
disadvantaged, special legislation and 
planning, which directly or indirectly 
impact on the quality and effective- 
ness of vocational education pro- 
grams for disadvantaged students (in 
terms of quality of training opportuni- 
ties, instruction, services available, 
job placement, and so forth) 

(3) To perform an assessment of a va- 
riety of secondary and post-secondary 
projects for the disadvantaged, in- 
cluding interviews with samples of© 
students and employers participaticjep' 
in the projects, and a sample of em- 
ployers not participating 

(4) To identify and analyze existing 
constraints or limitations in carrying 
out the various vocational education 
programs 

METHODOLOGY 

The assessment was conducted at 
the state, community, and project 
levels, and interviews were conducted 
with students and employers who 
were participating m the program. 
The term "community" was defined 
as "the local education jurisdiction" 
(local education agency or commu- 
nity college district) in which a sam- 
ple project was located. The samples 
selected consisted of the following: 

(1) States— 23 

(2) Communities — 77 
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(a) Local education agencies 
(LEAS) — 55 

(b) Community college districts 
-22 

(3) Projects — 84 

(a) Secondary --.62 

(b) Post-secondary — 22 

AtMhe state level, interviews were 
conducted with state directors of 
vocational education and their sub- 
ordinates m charge of programming 
for the disadvantaged At the commu- 
nity level, interviews were conducted 
with chairmen of members of boards 
of education or boards of regents, 
superintendents of schools or presi- 
dents of community colleges, and 
LEA or corfimunity college officers 
in charge of vocational education 
Finally, at the project or school level, 
one, interview schedule was used, but 
several respondents — including proj- 
ect directors, counselors, instructors, 
and school principals — contributed 
answers to various sections^of the 
schedule. 

Students participating in asubsam- 
ple of prcJjects located in states where 
the percentages of work experience 
programs were high were interviewed 
A total of 1.024 student interviews 
were conducted In the case of work 
experience programs, a sample of 
103 participating employers was also 
interviewed. 

ORGANIZATION OF THE SUMMARV 

The findings, conclusions, and recom- 
mendations of' the study have been 
summeyrized in the following four sec- 
tions:' 

(1) Interpretation of the term "dis- 
advantaged* 

(2) Policy and administration 
^ (3) The program 

(4) Recommendations 

THE MEANING OF "DISADVANTAGED*' 

The attempt was made in this study to 
determine the following ^ 
^1) How state and local administra- 
' tors define the term "disadvantaged" 



(2) The various eligibility criteria pro- 
mulgated by state and local adminis- 
trators 

(3) The various types of individual 
assessments performed for students 
enrolled in vocational education pro- 
grams for the disadvantaged 

FINDINGS AND CONCLUSIONS 

The evidence compiled warrants a 
number of findings and conclusions 

(1) State and local administrators had 
given little attention to interpreting 
the congressional definition of dis- 
advantaged student." As a result, 
programs differed widely between 
states and between communities, 
within states 

(2) Few states or local communities 
had issued eligibility criteria for en- 
rollment in disadvantaged programs, 
other than those contained in sug- 
gested, federal guidelines. 

(3) The reasons for the act s empha- 
sis on individual assessment was not 
well understood at either the state 
or local levels. In most instances, 
individual assessment was merely a 
means of documenting the disadvan- 
taged status of students enrolled in 
Part B set-aside and Section 102(b) 
projects. The question as to whether 
programs could be designed to meet 
the individual needs of students, dis- 
covered through individual assess- 
ments, was not often asked by state 
and local administrators. 

(4) The most common criterion used 
to identify disadvantaged students 
was dt5ade»>^c, that is, students who 
were one or more grade levels behind 
their peers. 

(5) Half of the project directors inter- 
viewed m connection with the project- 
level assessment 6\d( not believe that 
the students enrolled in their projects 
were disadvantaged, thereby illus- 
trating the confusion that exists from 
the state to the local level concerning 
the meaning of disadvantaged stu- 
dent." 

It appeared, therefore, that most 
states had devoted very little atten- 
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tion to the conceptualization of spe- 
cial vocational education services for 
the disadvantaged, based on specific 
criteria for the identification of dis- 
advantaged students and individual 
assessments of students either eli-' 
gible^or potentially eligible for such 
services. 

POLICY AND ADMINISTRATION 

In this section, the following subjects 
are summarized. (1) overview of na- 
tional statistics pertaining to the 
disadvantaged Part B set-aside pro- 
vision of the 1968 amendments, 
(2) allocation of resources at the 
community level, (3) state and local 
policy and administration of the 
Part B set-aside and Section 102(b) 
program, and (4) constraints, as per- 
ceived by state and local administra- 
tors, limiting the initiation ^f voca- 
tional education programs for the 
disadvantaged. 

National Statistical Overview 

The most important conclusion that 
could be drawn from an analysis of 
the data that states report to the fed- 
eral government each year is that 
they appear to contain anomalies 
which are difficult to explain. The 
wide ranges between states in the 
percentages of Part B funds expended 
for the disadvantaged, per enrollee 
costs, and data which appear to indi- 
cate that the costs for educating dis- 
advantaged students are lower than 
those for educating regular students, 
bring into question the accuracy and 
completeness of the state-reported 
data The probable reasons for these 
anomalies are that state definitions 
of the term "disadvantaged" vary so 
much that it is impossible to make 
interstate comparisons and that states 
report only partial, rather than actual, 
per-student costs. 

Allocation of Resources 
(Community Level) 

Two analyses of how communities 
allocate federal funds for the disad- 
vantaged were made; (1) by budget 
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line item, and (2) by the types of pro- 
grams funded. 

Budget line items. The vast majority 
of Part B set-aside and Section 102(b) 
funds were used to hire staff who 
work directly with students identified 
as disadvantaged. Only a small portion 
of the funds were used to hire admin- 
istrative and other noncontact per- 
sonnel. Thus, It can be concluded 
that most Part B set-aside and Section 
102(b) funds were being used to pro- 
vide direct services to students. 
Type of program. The types of pro- 
grams funded were divided into the 
following categories. (1 ) skills training 
(or training in either specific or 
general occupational areas), and 
(2) nonskllls training (or prevoca- 
tional training, remedial education, 
and world-of-work programs that are 
not integrated with skills training 
either in the classroom or on the 
job). The attempt was also made to 
identify the occupational areas in 
which skills training was offered. 

Sixty-nine percent of the high 
school students and 56 percent of 
post-secondary-level students were 
not enrolled in skills training pro- 
grams (see Figure 1) Thus, it would 
appear that the majority of Part B 
set-aside and Section 102(b) funds 
was being used fo'r the initiation of 
prevocational, remedial, and world- 
of-work programs. This was expe- 
cially true at the secondary level, 
where more than half of the stu- 
dents were enrolled in world-of-work 
and prevocational programs. If it can 
be assumed that remedial programs 
were integrated with skills programs, 
skills training was extremely narrow 
at both levels. The vast majority of 
high school students was enrolled m 
three occupational areas (business 
and office, trade and industrial, and 
diversified co-op), while only one oc- 
cupational area (business and office) 
accounted for most of the students 
enrolled in post-secondary skills train- 
ing programs. 




FIGURE 1 

Allocation of Resources by Type of Program 'for School Year 1974-75 
Secondary and Post-secondary 



Secondary 
(36 out of 55 sample 
communUles) 

All programs: 
10,150 enrollment 



Pott-secondary 
(17 out of 22 sample 
communities) 

All programs: 
5,816 enrollment 
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Skills training: 
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NOTE Does not include one-prevocational secondar^program in 
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Policy and Administration 

Although overall policy was imposed 
on the schools by the Vocational Ed u- 
cation Act amendments of 1968, the 
congressional mandate was suffi- 
ciently broad to allow considerable 
flexibility at the state and local levels. 
In designing and conducting this as- 
sessnnent, we nnade the assumption 
that issues relating to the provision 
of vocational education for the disad- 
vantaged were considered at the 
national, state, and local levels, and 
that a considerable body of policy 
formulations would be available to 
researchers The fact is, however, 
that the only comprehensive policy 
statement obtained was the Suggested 
Utiltzation of Resources and Guide 
for Expenditures (SURGE), issued by 
the US Departnnent of Health, Edu- 
cation and Welfare Carefully formu- 
lated formal policy statements were 
absent at both state and local levels 
regarding nnainstreaming, work edu- 
cation, the use of Part B set-aside 
versus Section 102(b) funds, coord h 
natFon with other agencies, .the use 
of advisory councils, and state ear- 
marking and community matching of 
funds Evidence from interviews wi^h 
77 members of boards of education 
and boards of regents indicated that 
boards rarely initiated policy with 
regard to either vocational education 
in general or vocational. education 
for the disadvantaged in particular 
State funding mettiods Most states 
(16 out of 23) required local education 
jurisdictions or schools to submit pro- 
posals to the state, according to e§; 
tablished guidelines, and funded proj- 
ects on the basis of the quality of the 
proposals and the ability of the spon- 
sors to carry out the projects (project- 
by-project basis) The remainder was 
funded on a block grant basis, i.e., 
to local education jurisdictions States 
which funded on a project-by-project 
basis had more administrative control 
over their programs The fact that 
sponsors were required to submit 
proposals which set down in writing 
the general and specific goals of 



projects, the characteristics of the 
students to be served, the educational 
techniques to be employed, and line 
Item budgets (including local funds, 
If any, to be contributed) implied a 
certain amount of planning and facili- 
tated both pre- and post-program 
evaluation. j 

Planning. State plans gave overall 
statewide estimations of the disad- 
vantaged populations within states, 
but state program officers appeared 
to be unacquainted with these fig- 
ures, nor were they able to identify 
the sources of the statistics It seemed, 
therefore, that state plans were drafted 
by persons or divisions other than the 
program officers or special needs divi- 
sions, and were considered to be little^ 
more than exercises in grantsman- 
ship The guidelines for state plans 
specify that goals or programs are to 
be clearly stated Despite this require- 
ment, m most instances the objectives 
were couched in broad terms, such 
as to provide the disadvantaged 
students of the state with necessary 
vocational education. This type of 
objective lends itself neither to con- 
crete planning nor to evaluation. 

It would be a mistake to say that no 
planning took place at the local level, 
but It IS accurate to maintain t^^at 
what planning did take place was of 
a short-term nature, generally directed 
at justifying specific projects. When 
asked about the universe of need or 
the establishment of priorities, most 
respondents expressed bewilderment 
"Planning," if it can be called that, 
consisted mainly of the design of 
•projects on an ad hoc basis, the ob- 
jective was to spend the Part B set- 
aside and SectionJ02(b) funds avail- 
able from the state 

Monitoring and evaluation. Consider- 
ing, the informality of the planning 
process, it should come as no sur- 
prise that the monitoring and evalua- 
tion of programs forHixe disadvan- 
taged was equally informal at both 
the state and local levels. State- and 
community-level reporting require- 
ments were minimal, and manage- 
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ment information systems were ex- 
tremely weak at both levels Where 
states funded on a project-by-proj- 
ect basis, the opportunity for moni- 
toring and evaluation was at least 
present However, in most states only 
one administrator was assigned the 
responsibility ior disadvantaged pro- 
gramming which meant that compre- 
hensive monitoring and evaluation 
was not possible In states where state 
education agencies were subdivided 
into regions, program monitoring 
and evaluation appeared to be more 
complete, and program officers ap- 
peared more knowledgeable about 
programs for the disadvantaged than 
in states which were not divided into 
regions. 

Constraints and Opportunities 

The major constraints mentioned by 
respondents at all levels were 

(1) Lack of funds 

(2) Lack of facilities 

(3) Unwithngness of some instruc- 
tional personnel to accept disadvan-* 
taged students into their classes 

(4) Negative image of vocational edu- 
cation 

(5) Ambiguity of the term disadvan- 
taged student' ^ 

Respondent recommendations at the 
state, community, and project levels 
included the following 

(1) Local school districts should not 
be required to match funds for voca- 
tional educat^on programs for the 
disadvantaged, federal funding 
should be on a two-yedr basis, and 
"seed'money" funding should be dis- 
continued. 

(2) In-service training should be pro- 
vided by the states for instructional 
personnel, and instructors should be 
evaluated on how welt they work with 
disadvantaged students, continued 
employment should be at least par- 
tially based on these evaluations 

(3) The federal government should 
define more precisely the meaning of 
the term disadvantaged," and states 
sho'uld establish, priorities and see 
that they are observed by local 
education jurisdictions. 



(4) More funds shoOld be allocated 
for planning, administration, and 
evaluation. 

THE PROGRAM 

The material that follows is a synthe- 
sis of findings and conclusions re- 
gi^rding on-site visits to 84 vocational 
education projects for the disadvan- 
taged in 23 states A project was de- 
fined as a Part B set-aside or Section 
102(b) grant to a school or local edu- 
cation jurisdiction for the purpose of 
providing specific educational ser- 
wces to the disadvantaged Block 
grants to local education jurisdictions 
for nonspecified services were not 
considered projects Projects broke 
down into two categories. 

(1) Regular Disadvantaged students 
were placed in regular vocational edu- 
cation programs with nondisadvan- 
taged students. 

(2) Special: Disadvantaged students 
were placed in separate vocational 
education classes, either on a full- or 
part-time basis. 

The matenal presented m this sec- 
tion IS organized as follows (1) sta- 
tistical overview of the project sample, 
(2) project administration, and (3) proj- 
ect outcomes 

Statistical Overview 

Mamstreammg. Two out of every three 
students enrolled in the projects (both 
secondary and post-secondary) were 
in regular classes, thus indicating that 
mainstreaming is considered appro- 
priate and feasible for many disadvan- 
taged students. 

Enrollee characteristics. Approxi- 
mately 46 percent of the enrollment 
in high school projects was minority, 
characteristics information by race 
and ethnic background vyas not avail- 
able for 51 percent of the post-secon- 
dary enrollment. Of the known post- 
secondary-levei enrollment. 22 per- 
cent were minority and 27 percent 
white. 

Women comprised a slightly higher 
percentage of the total high school 
enrollment than men. the opposite 
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was true at the post-secondary level 
However, characteristics by sex were 
unavailable for 34 percent of the 
post-secondary enrollment. Most of 
the high school students were be- 
tween sixteen and seventeen years 
of age, and in the tenth and eleventh 
grades, but, here again, the unknowns, 
were 62 percent (age) and 36 percent 
(grade) Age and grade information 
were unavailable for 63 percent and 
36 percent respectively of the post- 
secondary enrollment. 
Type of educatiof). Of the 62 high 
school projects, 29 (or 47 percent) 
had work education components. 
These projects accounted for 49 per- 
cent of the total enrollment in the 62 
projects Only two of the 2? post- 
secondary level projects, accounting 
")tJtv4 percent of the enrollment, had 
work education components How- 
ever\ because of the small size of 
the ppst-secondary level subsample, 
thes^ figures are not significant 

Project Administration 

Allocation of resources. FindiROs re- 
garding the allocation of resouaps for 
64 of the 84 sample proj^^Slfs sup- 
ported the community-level firfijings. 
At the high school level. 8^ percent 
of the 1974-75 expenditures were for 
direct services to students, the cor- 
responding figure at the post-secon- 
dary level was 74 percent Federal 
funds constituted 72 percent of aJI 
high school expenditures and 56 per- 
cent of all post-secondary-level ex- 
penditures. 

Admmistrative techniques The fact 
that half of the project directors inter- 
viewed djd not believe that the stu- 
dents enrolled in Part B set-aside 
and Section 102(b) programs for the 
disadvantaged were disadvantaged 
raised serious questions about the 
administration of the entire program. 
With respect to the administration 
of projects at the school level, there 
was a lack of criteria for identifying 
disadvantaged students, and ^a corre- 
sponding lack of adequate assess- 
ment procedures for determining 



the conditions which cause school 
failure These two factors may ac- 
count for the anomaly described 
above. If there is no definition of 
disadvantaged," no criteria through 
which disadvantaged individuals can 
be identified, and no assessment pro- 
cedures through which it can be 
deternnined whether students meet 
established criteria, the term "dis- 
advantaged* becomes meaningless 
Part of the problem may be due to a 
reluctance on the part of counselors 
and other school personnel to "label" 
students, but regardless of the cause, 
unless a target population is in some 
way identified, the program itself 
becomes nneaningless — a program 
without objectives. 

The Instructional Program 

The findings regarding types of pro- 
grams in which disadvantaged stu- 
dents were enrolled are as follows' 

(1) Students in the sample projects 
were enrolled in more nonskills train- 

.j^ng than skills training programs 
Nearly half of the secondary enroll- 
ment (47 percent) were in world-of- 
work projects, 47 percent of the post- 
secondary-level students were en- 
rolled in remedial programs It should 
be pointed out that students enrolled 
in remedial projects may also be en- 
rolled in skills training courses not 
funded out of Part B set-aside or Sec- 
tion 102(b) funds In such cases, dis- 
advantaged funds were being used 
to support students enrolled in regu- 
lar programs 

(2) Almost half of the high school 
students were enrolled m work ex- 
perience programs, indicating that it 
was not difficult to place disadvan- 
taged students in work situations 
However, the vast majority of stu- 
dents enrolled in work experience 
projects (86 percent) were not receiv- 
ing skills training in school, bringing 
into question the quality of work ex- 
perience projects funded for the dis- 
advantaged (see "work education" 
section which follows) 

(3) At both the secondary and post- 
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secondary levels, the majority of stu- 
dents enrolled m skill training pro- 
grams was not receiving instruction 
in specific occupational areas 
Occupational offenngs. As was dis- 
— GOvefed-aHt>e community level, train- 
ing for the disadvantaged seems to 
be concentrated in one occupational 
area, business and office occupa- 
ti6"ns More than half of the high 
school enrollment (55 percent) and 
virtually all the post-secondary en- 
rollment (95 percent) were in this 
area Because of the small size of 
the post-seQondary sample, these 
figures were not significant, but data 
regarding the high school projects 
lead to the overall conclusion that 
the range of occupational areas for 
disadvantaged students is extremely 
narrow ^ 

Curriculum and teaching methods 
The curriculum in use and Uie teach- 
ing methods employed were for the 
rnost part traditional. The one ingre- 
dient that seemed to be added was 
individual attention The instructors 
developed their own curriculums, 
using material developed by states, 
universities, local education agen- 
cies, and other sources Individual- 
ized instruction, based primarily on 
the development of program modules 
and the use of workbooks, was com- 
mon, excellent use was frequently 
made of audiovisual equipment in 
remedial programs There wgre a few 
unique programs which f^ure'd the 
use of hands-on training, but the 
majority of high school students were 
enrolled m world-of-work programs, 
and most post secondary level stu- 
dents were enrolled m remeA^al pro- 
grams, Thus, the developrj^^^olf cur- 
riculums was primarily m those two 
areas. 

Facilities and equipment. More than 
half of the project directors (57 per- 
cent) rated the equipment excellent , 
29 percent said that it was adequate , 
and 11 percent rated it inadequeite ' 
It should be emphasized, however, 
that world-of-work instructors, whose 
equipment needs were minimal, were 



included among those who rated 
equipment. Most of the adequate and 
inadequate ratings came from the 
project directors of skills training 
programs. The most frequently men- 
tioned need (by those who rated 
equipment as le^s than excellent) 
was material for individualized in- 
struction Other reasons for less than 
excellent ratings were, equipment out 
of date, equipment in poor repair, 
lack of visual aids, lack of tools, and 
materials too sophisticated for dis- 
advantaged students 
Work education. Although nearly half 
of the high school students enrolled 
in the sample projects were in work 
experience programs, the quality of 
the programs appeared to be ques- 
tionable. For example. 

(1) Agreements between schools and 
employers generally were not writ- 
ten, or signed, by the two parties. 
"Training plans" were virtually non- 
existent. 

(2) Almost 70 percent of the students 
iriterviewed rated their classwork as 
"somewhat" (41 percent) or "not at 
all" (27 percent) related to their on- 
the-job training, 

(3) Male students were receiving an 
average wage rate of $2,36 an hour, 
in comparison, the wage rate for fe- 
male students was $2.20 an hour, 

(4) According to the 442 work experi- 
ence students interviewed, the tasks 
they were performing on-the-job were 
in low-skill, low-pay, and high-turn- 
over occupations For example, 78 
percent of the tasks listed in the food 
services category were waitress, food 
handlers, busboys, and dishwashers, 
44 percent of the tasks listed under 
car maintenance were service station 
attendant, wash cars, and park cars, 
67 percent of the jobs listed under 
office work were general office work, 
filing, running errands, and so forth, 
80 percent of the jobs listed under 
child and hospital care were to take 
care of patients (give baths, and so 
on), and child care (baby sitting), and 
one-third of the jobs listed under con- 
struction were general construction 
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work (laboring), load trucks, and run 
errands. 

(5) Sex stereotyping. Besides being 
paid 26 cents an hour less than men, 
eight out of ten women enrolled in 
work .experience programs, were as^ 
signed to jobs in the following cate- 
gories, food service, child and hos- 
pital care, and cashier. No women 
were employed m car maintenance 
and repair, and of the 136 jobs listed 
under the construction category, only 
25 were listed by women — sixteen 
of which were light rhaintenance work 
and frve "run errands *' 

There can be no doubt that work 
experience programs were bemg 
funded for the disadvantaged, but 
there was some question as to their 
quality Most of the students were 
being placed in low-skill, low-paying 
jobs, which they pould probably apply 
for and obtain without first receiving 
vocational training and which pro- 
vided little bona fide on-the-job train- 
ing The serious question that arises 
is: are Part B set-aside and Section 
102(b) funds bemg us'ed to create a 
new lower track for disadvantaged 
students, just the opposite of what 
the act intended*? 

Project Outcomes 

Whatever the deficiencies of program 
administration, there can be no doubt 
that the available outcomes data indi- 
cated that the Part B set-aside and 
Section 102(b) program for the ()\S' 
advantaged was operating on a suc- 
cessful basis. For example 

(1) Program costs at $395 per ej- 
rollee (federal costs) and $401 per 
enrollee (combined federal, state, and 
local) were low. 

(2) The average completion rate (83 
percent) was high. 

(3) St^udent ratings of the programs 
were overwhelmingly favorable ^ 

(4) Employer ratings of the programs 
and their student employees were 
also overwhelmingly favorable. 

These data would be a good deal 
more significant, however, if it could 
be ascertained that the intended tar- 



get population was well defined, let 
alone well served, and that the pro- 
grams were designed to overcome 
conditions — determined by means of 
individual assessment ^ that cause 
__sc h 6 ol failu re With r ega rd to t he 
employer interviews, if it was true 
that the schools — through work edu- 
cation programs — were acting as re- 
ferral agencies for employers in the 
secondary labor market (employers 
of low-wage, low-skill workers in high- 
turnover jobs), empjoyer enthusiasm 
for the program wOXJid be expected 

RECOMMENDATIONS 

Summary and Conclusions 

The conclusions of the study can be 
best summarized by commenting on 
SIX congressional assumptions upon 
which the disadvantaged provisions 
of the 1968 amendments were based. 
The assumptions will be stated first, 
and the comments will follow. 
(1) Need for disadvantaged Part B 
set-aside: Prior to 1968, many disad- 
vantaged students either were not 
enrolled in vocational education pro- 
grams or. if they were enrolled, ^ere 
not being provided with the kinds of 
services they needed to succeed 
Comments: While vocational educa- 
tors did not disagree with the above 
assumption, they contended that vo- 
cational education has al^^^s been 
considered a referral grounds for 
academic rejects, and that pVu mJo > 
1968, the program was underfunded, 
underequipped, and received little 
consideration from policy makers at 
any I^W They also resented the im- 
plied cmicism that vocational educa-^ 
tion IS "elitist" and, that when the 
disadvantaged became a national pri- 
ority, the major burden for solving 
I the educational problems of the dis- 
' advantaged was delegated to voca- 
tional Education. This factor, more 
than any other, may account for the . 
less than enthusiastic administration 
ijof the program. 

1(2) Meaning of disadvantaged" There 
IS a common understanding of the 
characteristics of disadvantaged stu- 
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dents (for identification purposes), or 
a common undejstending of themean- 
/ng of disadvantaged Comments. The 
term "disadvantaged" was interpreted 
m its broadest sense and vaned widely 
from state to state, community to 
community, and school to school. 
There was no common meaning of 
the term and no common understand- 
ing of the characteristics of disad- 
vantage students As a result, the 
Part B set-aside provision for the dis- 
advantaged appeared to be a program 
m search of a target group 

(3) Assessment Assessment tech- 
niques exist or can be developed 
whereby the conditions which result 
m school failure can be identified on 
an individual basis Comments. As- 
sessment techniques may exist or 
may have been developed, but, if so. 
they were not being used to identify 
disadvantaged students, or to dis- 
cover individual conditions which 
cause school failure. The informal 
assessment process was directed to- 
ward justifying the disadvantaged 
status of students enrolled in Part 
B set-aside and Section 102(b) pro- 
grams, rather than toward the' iden- 
tification of conditions which result 
m school failure. 

(4) Education treatments' Educational 
treatments exist or can be developed 
which can be applied to students suf- 
fering from conditions which cause 
school failure. Comments, Without 
individualized assessments of stu- 
dents screened into the program, it 
was not surprising that educational 
treatments, ' if they can be called that, 
were so broad that they were virtually 
unidentifiable The one individual 
treatment that prevailed was indi- 
vidual attention." 

(5) Planning A body of data exists or 
can be developed which facilitates 
state and local planning for the dis- 
advantaged, the establishment of pri- 
orities, and the allocation of funds 
to local education jurisdictions on a 
rational basis. Comments Without 
clear definitions of the term disad- 
vantaged, and the application of in- 



dividual assessment techniques, plan- 
ning—except m a general sense — 
was all but impossible. Planning was 
generally done on an ad hoc basis, 
that IS, the money was there to be 
spent, and projects had to be de- 
signed to justify the expenditures. 
(6) Programming, There is a common 
understanding of the kinds of pro- 
grams thaV should be funded for the 
disadvantaged (e.g . solely occupa- 
tional skills training, or a va^ety of 
services, including remedial educa- 
tion, counseling, prevocational train- 
ing, world-of-work instruction, work 
education, and so forth). Comments. 
The types of occupational training 
programs m which disadvantaged 
students were be-ing enrolled were 
few in number and of questionable 
value. Half of all high school students 
were enrolled in worl^l-of-work or low- 
quality work experience programs, 
few were enrolled in skills training 
programs — innovative or non-inno- 
vative At the post-secondary levfel, 
most students were enrolled in re- 
medial education programs, presum- 
ably, they were also enrolled in skills 
training programs not supported by 
Part B set-aside or Section 102(b) 
funds. 

Recommendations 

The 1976 amendments to the Voca- 
tional Education Act of 1963 not only 
continue the disadvantaged set-asides, 
but under Part B of the act, inSfrease 
the percentage of the funds set aside 
for the disadvantaged from 15 to 20 
percent The new act, however, re- 
quires that the 20 percent set-aside 
be used .to finance 50 percent of the 
costs of providing vocational training 
and services to the disadvantaged, in 
other words, states and local commu- 
nities must now not only match total 
Part B grants, but also the portion of 
those grants which are used to fund 
prograrns for the disadvantaged. Fi- 
nally, the 1976 amendments require 
that the states perform more compre- 
hensive monitoring and evaluation of 
vocational education programs With 
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these factors m mind, we believe that 
consideration must be given to the 
following recommendations 
1. Definition of disadvantaged. The 
target group for'the Part B set-aside 
and Section 102(b) program must be 
defined more precisely. It is possible 
that th^term "disadvantaged" should 
be discontinued, since it has nega- 
tive connotations to vocational edu- 
cators, and Its meaning is unclear 
Whether or not the term is discon- 
tinued, program priority must be given 
to socioeconomically deprived groups 
or target areas whose members or 
residents are most likely to be m 
need of the special programs or ser- 
vices made possible by the 1968 act 

2 Student assessn)ent. At the same 
time, the identification of students 
from these target areas or groups, 
on an individual b^sis. must not only 
be continued but strengthened. The 
mtent of the act regarding individual 
identification must be made clear to 
state and local administrators, and 
guidelines for the performance of in- 
dividual assessments must be made 
more explicit 

3 Organization Each state must have 
at least one person whose sole re- 
sponsibility IS to plan and carry out 
programming for the disadvantaged. 
Where two or more persons have 
these state responsibilities, one 
should be assigned as coordinator 

4 Planning. The person with respon- 
sibilities for planning programs for 
the disadvantaged must be given ade- 
quate support to set up these state- 
wide programs To accomplish this, 
th^ problem officer must work with, 
people who represent special educa- 
tion, migrant workers, the American 
Indian, compensatory education, adult 
basic education, and dropout preven- 
tion divisions (or programs), and re- 
search and statistics, and with com- 
munity program officers in order to 
determine needs and establish pri- 
orities 

5 Funding It should be required that 
projects be funded on the basis of 
written proposals Clear and specific 
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guidelines based on the federal guide- 
lines, but adapted to state needs, 
must be provided to local educational 
jurisdictions It is strongfy suggested 
that allocation oLJunds be based on 
proposals which are within priorities 
established at the state level ("4" 
above) 

6 Proposals Proposals from schools 
or local education jurisdictions must 
be reviewed carefully to see that the 
guidelines have been followed, that 
every student involved can be iden- 
tified, that there is a description of 
the special services required to help 
the student succeed, and that evalua- 
tion IS built into the proposed pro- 
grams 

7 Evaluation An on-site evaluation of 
at least 33 percent of the programs 
funded in whole or in part with Part 
B set-aside or Section 102(b) funds 
for the disadvantaged must be made 
annually Personnel from other state 
vocational education divisions should 
be involved as often as possible 

8 Review of proposals The following 
should be involved m the review of 
proposals submitted by local educa- 
tional jurisdictions or schools 

(a) State vocational education per-' 
sonnel from the occupational ser- 
vice areas. 

(b) Persons involved in planning, 
education, and training of the target 
population under other programs, 
including special education. ESEA 
Title 1. bilingual, migrant, agd 
CETA 

9 Establishnient of priorities To the 
greatest extent possible, all other 
parts of the Vocational Education Act 
amendments of 1976 should be tied 
together in the planning of a compre- 
hensive program for the disadvan- 
taged, and procedures should be de- 
veloped to ensure that 

> (a) The state plan is followed 
(b) Areas of economic depression, 
high youth unemployment and high 
school dropouts are given priority 
attention. 

10 Pre- and in-service training States, 
must provide for in-service training 
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of staff, either directly or by contract 
Teacher training institutions must be 
involved in this effort Curricultjm 
changes in pre-service leacher edu- 
cation programs enabling potential 
vocational education staff to be better 
prepared for working with the dis- 
advantaged should be instituted. 

11 Advisory councils. State advisory 
council members representing the 
disadvantaged must t^e continuously 
consulted and advised by program 
officers in charge of programming for 
the disadvantaged through a formal 
mechanism. 

12 Section 102(b) funds It should be 
required that Section 102(b) funds be 
used only in areas where it is finan- 
cially not feasible for local educational 
junsdictions to match state funds, or 
for ej^perimental and demonstration 
projects in correctional institutions, 
areas of economic depression, or 
areas of high youth unemployment 
and excessive school dropouts 

13 Programs. A review must be made 
of the types of programs funded for 
the disadvantaged to determine 
whether adequate skills training is 
available for disadvantaged students, 
and the appropriateness of world-of- 
work and remedial education pro- 
grams funded for the disadvantaged 

14 Work education. States must de- 
velop policies and standards with 
regard to work experience programs 
for the disadvantaged Great care 
should be taken to make certain that 
disadvantaged students are not being 
referred into the secondary labor 
market (low-pay. low-skill, high-turn- 
over jobs), and that the training they 
receive on the job is legitimate voca- 
tional training Administrators at all 
levels must be aware of the danger 
of creating inferior (or lower track) 
programs for the disadvantaged stu- 
dents. 

15. Coordination with other agencies 
Administrators at the community level 
should be required to coordinate their 
programs for the disadvantaged with 
other agencies (school and non- 
school) which provide services to the 



target population. States should re- 
quire that proposals from local edu- 
cation jurisdictions indicate efforts 
that have been made m this direction 
16. Management information system. 
It should be required that local edu- 
cational jurisdiction proposals con- 
tain specific measurable objectives, 
as well as an adequate description of 
the evaluation processes to be used, 
and management information systems 
at both the local and state levels 
should be installed — based on these 
objectives and evaluatfon processes 
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An Assessment of Vocational Education Programs 
for ttie Handicapped under the 1968 Amendments 
to the Vocational Education Act: A Summary 



JOHN WALSH 
Olympus Research 
Corporation 

Society's approach to thje handi- 
capped — to those who because of 
physical, mental, or emotional dis- 
abilities do not meet some mdivjd- 
uals' idea of "normal" — has almost 
always been ambivalent. The reaction 
of the non-handicapped to the handi- 
capped IS often one of discomfort 
— and sometimes of manifest revul- 
sion Employers and their employees 
often shun the handicapped because 
of the way they look" or because 
they assume that the handicapped are 
not as competent — at any job — as 
the non-handicapped. Partly as a 
result of these all-too-common atti- 
tudes, the handicapped have been 
segregated, or have segregated them- 
selves, and until recent years efforts 
to bring them into the mainstream of 
society have been both rare and with- 
out widespread success 

Many of the difficulties faced by 
the handicapped are less the result 
of their handicapping conditions than 
of society's perception of such condi- 
tions The designation handicapped 
not only sets individuals apart from 
the rest of the population but also 
carries a strong negative connotation 
of incompleteness or incompetence.* 
Attempts to classify the handicapped 
into such categories as educable 
mentally retarded," "speech im- 
paired," "hard of hearing," and 
blind" artf often arbitrary in their 
failure to account for individual dif- 
ferences and aren|pmetimes inaccu- 
rate or mislead ingr^ 

These problems are compounded 
in the educational and employment 



arenas. Traditionally, there has been 
little emphasis in vocational educa- 
tion on programming for the handi- 
capped. Handicapped students who 
could not compete on an equal basis 
with the non-handlcapp^d had to 
look outside the regular vocational 
education establishment for rare op- 
portunities available to them in shel- 
tered workshops, private training 
programs, or institutions for the 
handicapped. Even rarer were train- 
ing opportunities that prep'ared the 
handicapped to compete in the open 
labor market with the non-handi- 
capped. There was little access to 
the normal world of work for that 
door was closed 

In the early 1960s, spokesmen for 
the handicapped began to impress 
this waste of human potential on the 
public mind, and m 1963 Congress 
passed the Vocational Education Act 
which charged the states with the 
responsibility of providing vocational 
programming for the handicapped 
After four years had passed, however, 
this general legislative charge had 
produced few new opportunities for 
handicapped individ^uals. Thus in the 
amendments to the*Act in 1968, Con- 
gress required that 10 percent of 
each state's basic grant for vocational 
education (Part B of the amendmen!^) 
be used exclusively to finance pro- 
grams "for handicapped persons who 
because of their handicapping condi- 
tion cannot succeed in the regular 
vocational education program with- 
out special educational assistance or 
who require a modified educational 
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"program " The aTnendments defined 
the term handicapped as persons 
who are mentally retarded, hard of 
hearing, speech impaired, visually 
handicapped, seriously ennotionally 
disturbed, crippled or other health 
impaired persons who by reason 
thereof requre special educational 
and related services." 

The amendments have now been 
in operation for four years in most 
states, but as of June 1973, little was 
known of the strategies adopted 
by the states for allocating funds 
under the amendnnents, state planning 
for the set-aside program, methods of 
seleetlng local progranns for support, 
an|Rhe extent of support provided by 
soPrces other than vocational educa- 
tion. Consequently, in June 1973, the 
US Office of Education entered into 
a contract with Olympus Research 
Corporation (ORC) to perform an as- 
sessmertl of the Part B set-aside pro- 
gram for the handicapped The overall 
purposes of the study were as follows" 

(1) To provide programmatlcally use- 
ful information on the relationships 
between post-program performance 
and the kinds of experiences that 
handicapped students receive in 
variou§ vocational education pro- 
grams 

(2) To identify and analyze existing 
constraints or limitations in carrying 
out the various vocational education 
programs for handicapped students, 
tncluding constraints internal to the 
program and those external to the 
program 

(3) To determine the feasibility of ex- 
panding a work experience compo- 
nent in vocational programs for the 
handicapped and the conditions 
under which expansion is possible 

(4) To examine the strategies used 
by states in identifying, handicapped 
students and their need for services, 
and the selection of projects for fund- 
ing 

(5) To determine to the extent possible 
the degree to which funds Jrom the 
10 percent set-aside under Part B for 
handicapped students actually reach 



handicapped students rather tharr 
become indistinguishable from other 
vocational education funds 

ORC designed a three-part ap- 
proach for carrying out the objec- 
tives of the study: (1) an assessment 
of program administration atthe state 
level. (2) a project level assessment 
of vocational education programs for 
the handicapped, and (3) case^^dy 
interviews with students, parents, 
and employers. 

Visits were made to 25 states, se- 
lected randomly with a probability 
proportionate to total enrollments 
m the fifty states. Directors of voca- 
tional education and special educa- 
tion, program officers, and research 
and statistical personnel were inter- 
viewed at the state level. 

A total of 92 projects was visited m 
conjunction with the project level 
assessment. The projects were di- 
vided into two subsamples (1) 74 
projects m 19 states which were rep- 
resentative of all projects m those 
states and (2) a purposive sample of 
18 projects m three rural states and 
California. To the extent possible, 
data collection forms (which included 
enrollment, fiscal, occupational offer- 
ings, and outcomes information) were 
filled out for each project, &nd inter- 
views were conducted with project 
directors, school principals, coun- 
selors, instructors, and local educa- 
tion agencies special education offi- 
cers at each site. 

A total of 1,001 student and parent 
interviews was conducted in five of 
the sample states, 681 with students 
currently enrolled and 320 with stu- 
dents who had completed projects 
during the 1972-73 school year. The 
number of employers interviewed 
totaled 165, of these, 94 were partici- 
pating in the projects and 74 were 
not participating. All interviews were 
conducted by Decision Making In- 
formation (DMI) under subcontract 
to ORC. 

Through an analysis of the infor- 
mation emanating from these three 
separate but interrelated parts of the 
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overall study, the attempt to fulfill 
the objectives of the study was ear- 
ned out. 

SUMMARY OF FINDINGS 

It should be emphasized that the 
study conducted by ORC-DMI was 
an assessment, not an evaluation of 
the Part B set-aside program The 
program was not measured against 
a set of criteria of what constitutes 
a "good" program Rather, the at*^ 
tempt was made to determine how 
states, local education agencies and 
schools are coping with the Part B 
set-aside, both from an administra- 
tive and program point of view. The 
analysis which follows is organized 
along the Ijnes of (he approach taken 
by ORG. that is. summaries of the 
major findings of the state and proj- 
ect level assessments, and of the stu- 
dent, parent, and employer interviews. 
Subsequent sections of the executive 
summary contain ORCs overall con- 
clusions and recommendations 

Although some of the findings may 
appear to be negative, it should be 
kept m mind that the most important 
findmg of the study is that Part B set- 
asida funding has resulted in voca- 
tional education projects for the 
handicapped that would never had 
occurred had there been no such 
legislation and that most of the set- 
aside funds were being used to provide 
direct services for the handicapped 
Many of the program weaknesses 
identified in the state aQjd project 
level assessments were administra- 
tive in nature and may be partly 
due to inexperience on the pa«^f 
of vocational education adminis- 
trators who have never before been 
given the responsibility of providing 
educational services for handicapped 
individuals One conclusion is in- 
escapable If vocational educators 
were to correct some of the major 
administrative weaknesses — weak- 
nesses which may not be their sole 
responsibility — funds now being 
spent to provide direct services for 
the handicapped would be siphoned 



off for administrative purposes. This 
tradeoff should be kept in mind 
when reading the remainder of the 
summary."^ 

THE STATE LEVEL ASSESSMENT 

The state level assessment was con- 
ducted in 25 states. It included anal- 
yses of the adequacy of state level 
management information systems, 
^ate-admmtstration Of the set-aside 
. program, and an operational profile 
of how states plan for, fund, moni- 
tor, and evaluate the Part B set-aside 
program for the handicapped. The 
review of statewide management in- 
formation systems was not limhted 
to the 25 sample states. Data reported 
by all fifty states to the U.S. Office 
of Education were reviewed (see 
belovyr). 

Managemsnt Information Systems 

''Each year, the states are required to 
report a wide range of data on set- 
aside programs to the Office of Edu- 
cation (e.g , program costs, enroll- 
ments, and completions) Because of 
this requirement," It was anticipated 
that such data would be readily avail- 
able at the state level However, this 
did not prove to be the case It was ' 
decided therefore that we examine 
the data reported by the fifty states 
to the Office of Education to deter- 
mine whether it would be more com- 
plete than information collected by 
research teams at the state level It 
was found, that most of the national 
data were either incomplete or inaccu- 
rate The two subset paragraphs be- 
low are an example. 
Completer information. The number 
of completers reported ranged from 
4,392 in Florida to none m New York, 
California, and Ohio Michigan re- 
ported eight completers, Oklahoma 
2.240. In Minnesota, 73 percent of the 
program enrollees completed, the 
corresponding figure for Texas was 
only 4 percent Clearly the states were 
not in agreement on how to satisfy 
this particular reporting requirement. 
Some had no figures at all to report. 
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Others apparently reported scattered 
completer figures from some but not 
all of the projects within their states. 
There were several reasons for the 
erratic nature of this information. 
Perhaps the most important was that 
many states did not require schools 
to report on completers. The second 
was that even in those states which 
required schools to report on com- 
pleters, there was no common defi- 
^4»on of the term completer, " In 
sl3<Tie states, for example, students 
werfesnot considered completers until 
they entered the labor force, or did 
not reenroll in school (either in the 
project or m other classes). In other 
states, TTt% sole criterion for com- 
pleter was that the student remain 
m school for one year. Regardless of 
the reasons, national data on handi- 
capped completers was not useful 
for program monitoring purposes or 
for making comparisons between 
states. 

Average costs. According to data re- 
ported by the states to the Office of 
Education, average costs per handi- 
capped student ranged from a high 
of $1,664 to a low of $44 This wide 
range of per-student costs raised the 
question as to what the states in- 
cluded in the "total exgenditures for 
the handicapped" category^""fo( ex^ 
ample, did they include only those 
funds that represented expenditures 
over and above the basic expendi- 
tures made-for^aJI students, or did 
they include all expenditures made for 
handicappe^ students'? It may be that 
varying interpretations of what is 
asked for injtiis category^ were in^part 
responsible for the wide range of 
costs per enrollee 

Other data dealing jf^olely with ex- 
penditures and enrollments appeared 
to be more accurate and revealed 
some interesting insights regarding 
vocational education programs for 
the handicapped For example, a com- 
parison of total state expenditures 
for the handicapped with expendi- 
tures under the Part B set-aside pro- 
gram showed that without the Part 



B set-aside, there would be few voca- 
tional education opportunities for 
the handicapped In 17 states, there 
were virtually no differences between 
total expenditures for the handi- 
capped and expenditures under the 
set-aside program In all but a few 
states, the differences were not sig- 
nificant. 

Comparisons between percentages 
of total enrollments that were handi- 
capped and percentages of all funds 
expended for the handicapped indi- 
cate that in most states the costs for 
educating handicapped students were 
higher than the costs for educating 
the non-handicapped, that is, per- 
centages of funds spent for the handi- 
capped were higher than percentages 
of total enrollments that were handi- 
capped Thus in 38 states it appeared 
that total per-student expenditures 
for the handicapped were higher than 
per-student expenditures for regular 
students. However, in 12 states, per- 
student expenditures for the handi- 
capped appeared to be either the 
same as or lower than those for regu- 
lar students 

Finally, in 35 states expenditures 
for the handicapped during fiscal 
year 1973 equaled 10 percent or more 
of total expenditures. This does not 
necessarily mean that the 15 states 
'vvhose expenditures were less than 
10 percent were not in conformity 
.^it^rthe law Fiscal year expenditure 
data include not only allotments but 
also carryover funds from the pre- 
vious fiscal year Thus, it was impos- 
sible to determine whether the fifteen 
states whose handicapped expendi- 
tures were less than 10 percent were 
or were not in conformity with the law 

The major conclusion drawn from 
the examination of national data, and 
from attempts to collect fiscal and 
program data a*t both the state and lo- 
cal levels, was that complete and 
accurate fiscal and program informa- 
tion — Information necessary for the 
proper monitoring and evaluation of 
individual projects, statewide pro- 
grams, and the overall national pro- 
gram — was not available at any level. 
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Organizational Profile 

All material relating to the organiza- 
tional operational profiles which 
follow are based solely on assessment 
performed m the 25 sample states. 
Aside from the specific fiscal set- 
aside, the ASM.amendments detail 
organizational, operating, and report- 
4 ing requirements that apply to Part B 
funds in general but are nevertheless 
specifically relevant to programming 
for the handicapped. One of these 
requirements is the establishment of 
a state advisory council, which must 
include a member knowledgeable m 
the special education needs of the 
handicapped and which must evalu- 
ate the programs funded under the 
amendments Another is that state 
divisions of vocational education 
enter into cooperative agreements 
with other agencies in the adminis- 
tration of vocational education pro- 
grams. State planning, funding 
procedures, and monitoring and 
evaluation are discussed in Opera- 
tional Profile which follows this 
section The Organization Pro- 
file" section deals with the struc- 
tures devised by states for the admin- 
istration of the set>aside program, 
the use of advisory councils, and 
interagency cooperation 
State structures. One program offi- 
cer ' was responsible for handi- 
capped programming m all but one 
of the 25 sample states The single 
exception was a geographically large 
rural state in which the director of 
vocational education assumed re- 
sponsibility for handicapped pro- 
gramming. Program officers oper- 
ated at the third organizational level, 
that IS. their superiors reported di- 
rectly to directors of vocational edu- 
cation They .were located in Special 
Needs Divisions (the names of these 
divisions varied f^pm state to state) 
which also had responsibility for the 
disadvantaged Although the use of 
only one individual to carry out all 
administrative functions under the 
set-aside program resulted in low 
administrative costs — a characteris-. 



tic of this program — it also explained 
why state level planning, monitoring, 
and evaluation regarding program- 
ming for the handicapped were at 
best sketchy and at worst nonexistent 
Advisory councils. In theory, state 
advisory councils are supposed to as- 
sist directors of vocational education 
in initiating programs for the handi- 
capped The amendments charge such 
councils with planning and evalua- 
tion responsibilities and also require 
them to have one or more representa- 
tives experienced in the education 
and training of handicapped per- 
sons " All program officers inter-, 
viewed were aware of their state coun- 
cils and of the council liaison officers 
within their state agencies, and sev- 
eral could identify the handicapped 
specialists on the councils. However, 
although not one of the respondents 
complained of the ineffectiveness of 
the councils, none cited examples of 
council activity in any phase of the 
set-aside program. Apparently there 
was virtually no concrete assistance 
provided by the councils, and none 
seemed to be expected by the pro- 
gram* officers. 

Relationships with other agencies 
The state level assessment indicated 
that although cooperative relation- 
ships existed between divisions of 
vocational education and divisions of 
special education — and in a few 
states, departments of vocational re- 
habilitation — in most states even 
these were relatively nonproductive, 
and for all practical purposes, rela- 
tionships with other agencies were 
nonexistent. 

In Minnesota, a coordinator was 
jointly funded by vocational educa- 
tion and special education. The sole 
responsibility of the person occupy- 
ing this position was to coordinate 
the activities of the^two agencies in 
vocational programming for the handi- 
capped. In eight other states, persons 
occupying other positions (either in 
vocational education or special edu- 
cation) were assigned the coordinat- 
ing responsibility. In still another 12 
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states, the oniy relationship that 
existed between the two agencies 
was that special education was given 
the opportunity to review all pro- 
posals for vocational education proj- 
ects for the handicapped In the re- 
maining four states, there were no 
formal relationships between the two 
agencies. 

Formal relationships existed v\^ith 
departments of vocational rehabili- 
tation in 14 states. However, only 
seven of these agreements actually 
resulted in the provision of services 
by vocational rehabilitation to stu- 
dents enrolled orrthe Part B set-aside 
program Among the services pro- 
vided by vocational rehabilitation in 
these seven states were placement, 
counseling, student evaluation, plan- 
ning assistance, purchase of services 
not otherwise available, and occa- 
sional joint funding of projects Agree- 
ments with vocational rehabilitation 
were nonexistent in, 11 states. 

There appeared to be a lack of 
agreement among state program offi- 
cers as to whether vocational rehabili- 
tation can legitimately provide sup- 
portive and additional services to 
secondary level handicapped voca- 
tional education students The most 
common explanation for the lack of 
direct invoJvement by vocational re- 
habilitation was that its client popu- 
lation IS of an older age group How- 
ever, the fact that in at least seven 
states vocational rehabilitation did 



ming for the handicapped, techniques 
for funding local education agencies 
or individual schools, and techniques 
for monitoring and evaluating funded 
projects. 

Universe of need. Although states go 
through the motions of drafting state 
plans, including plans forttie handi- 
capped, all respondents interviewed 
were vague as to whether attempts 
were made to identify the number of 
handicapped individuals who could 
benefit from vocational education, 
or breakdowns of handicapped stu- 
dents by handicapping condition. The 
general consensus was that these are 
local responsibilities. However, based 
on the kinds of information required 
by states in project proposals and on 
state reporting requirements, it ap- 
peared that state vocational educa- 
tion administrator^ did not consider 
the gathering of universe of need in- 
yformation a major pnority (this sub- 
ject IS discussed in more detail in 
the paragraphs describing the project 
level assessment). 

Planning. Planning was also con- 
sidered a local responsibility. Plan- 
ning at the state level was limited to 
the review of project proposals and 
decisions as to which proposals would 
be funded, generally on the basis of 
the sizes of school districts gPnd other 
formulas. Factors which mitigated 
against planning at the state level 
were the independence of the local 



. education agencies and the fact that 
provide services to^students jrUtie ^^ly one person was assigned to the 
set-aside program indicates that simi-^^^^^^^^^^^^.o^ of ^he set-aside pro- 
lar agreements could be reached in \ 
other states. 



Only four states reported agree- 
ments with the employment service, 
and of these, only two produced a 
significant amount of activity. Agree- 
ments with other agencies were so 
Tew as to be insignificant 

Operational Profile. 

The assessment of state level opera- 
tion of the set-aside program included 
the identification of techniques em- 
ployed to discover the ' universe of 
need, to plan vocational program- 



gram. 

Funding procedures Twenty-two of 
the 25 sample states funded "proj- 
ects"; that. IS, specific programs for 
the handicapped submitted in pro- 
posal form to the states by local 
education agencies and individual 
schools. Two states, California and 
Georgia, provided block grants to 
local education agenices on a for- 
mula basis. One state (Illinois) reifli- 
bursed schools for each credit hour 
handicapped individuals were en- 
rolled in vocational education pro- 
grams. 
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Proponents of the block grant 
method of funding emphasized that 
such a procedure resulted in maxi- 
munn flexibility to local education 
agencies, that is. these agencies were 
not Mocked" into specific projects 
but could apply the funds through- 
out the-schooi year where they were 
most needed There were, however, 
two weaknesses to the block grant 
method (1) states had [ittle control 
over the programs instituted by local 
education agencies and (2) the allo- 
cations of set-aside funds to some 
local education agencies were so 
small as to be insignificant The 
former appeared to be the most seri- 
ous drawback to the block grant 
method Fiscal and program infor- 
mation regarding current programs 
was virtually nonexistent in states 
which allocated set-aside funds on 
a block grant basis to local educa- 
tion agencies The major reason for 
this was that local education agen- 
cies used a post facto auditing pro- 
cedure for accounting for set-aside 
funds, that is. the funds were not 
applied to service categories until 
after the completion of the fiscal or 
school year State monitoring and 
evaluation of set-aside programs 
were virtually inSpossible under this 
system With regard to the second 
drawback, many local education 
agencies whose allocations were 
small turned the funds back to the 
atates Special projects were then 
funded with the unused allocations 

States that funded projects had 
far better control over their programs 
than those that did not Program offi- 
cers could account for services pur- 
chased with set-aside funds and the 
number of handicapped persons en- 
rolled in the projects In those states 
with comprehensive reporting re- 
quirements (a small minority), it was 
possible to account for dropouts, 
completions, and placements (more 
on this subject below) The question 
appeared to be"^whether "control" 
should be sacrjficed^for local educa- 
tion agency "flexibility ' The state 



level assessment indicated that the 
project method need not result in 
a lack of flexibility. Project proposals 
could be modified, often without an 
excess of paper work, thus assuring 
some local flexibility. More impor- 
tantly, there was a certain amount 
o^-pla^nnmg ^hjiI^ ir>to^4he- projeel 
method. The purposes of projects 
were spelled out, justifications for 
the types of projects proposed and 
the types of handicapped students 
to be served were contained in proj- 
ect proposals, and the methods which 
the purposes were to be realized were 
summarized. These, together with 
line Item budgets, made monitoring 
and evaluation possible, albeit weak, 
in most states. 

Several states used set-aside funds 
as "seed money", that is, projects 
were funded only if local education 
agencies or schools agreed to gradu- 
ally increase local financing of the 
projects so that eventually the proj- 
ects would be 100 percent locally 
funded One state required assurance 
that projects would be locally funded 
during the second year of operation, 
most required a graduaJ reduction of 
federal funds over a three- to five- 
year-perioJa. A follow-up study should 
be carriedlout to determine how the 
seed monev concept is working in 
practice. 

Monitoring arw^valuation. In most 
states, monitoring and evaluation 
were hampered by the lack of state 
requirements for vital program and 
fiscal information For example, fiscal 
information was not available in any 
standard format There were no break- 
downs by anticipated and actual ex- 
penditures, and except in some proj- 
ect proposals, no breakdowns by types 
of services funded. Actual enrollment 
figures were not available, and in 
mgst states, there was little informa- 
tion on completers, dropouts, and 
placements. Follow-up data were not 
available in any state. There were in- 
dications that some states recognized 
this problem and were taking steps 
to correct it. Sophisticated, computer- 
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ized systems were bemg mstalled in 
several states, and m a few, program 
officers were reviewing the report- 
ing requirements they impose on 
iocal education agencies and schools. 
For the most part, however, data nec- 
essary for monitoring and evaluating 
projects WHS serioosty dehcten^t 3t 
the state level. 

Summary \^ 

The deficiencies of state level admin^ 
istration of the Part B set-aside pro- 
gram for the handicapped must be 
measured against the low cost of 
state level administration One pro- 
gram officer in each state Is expected 
to consult with advisory councils, 
enter into cooperative agreements 
With outside agencies, and plan, fund, 
and monitor a statewide program. 
Nevertheless, if additional staff were 
allocated for stale level administra- 
tion, the chances are that there would 
be fewer funds availajDle for direct 
services to the handicapped. It could 
happen no other way, unless state 
agencies agreed to absorb the in- 
creased administrative costs, or un- 
less inter-agency agreements made 
tt possible for staff from several agen- 
cies (special education and voca- 
tional rehabilitation, fpr example) to 
aid in the administration of set-aside 
programs. 

At the present time, however, state 
level administrators consider them- 
selves solicitors and funders of proj- 
ects; they do not consider themselves 
designers of statewide programs 
Thus information needed for plan- 
ning, monitoring, and evaluation is 
not a major concern of program offi- 
cers charged with the responsibility 
of administering the set-aside pro- 
gram 

THE PROJECT LEVEL ASSESSMENT 

The purpose of the project level as- 
sessment was to examine the vanous 
ways local administrators identified 
handicapped individuals who quali- 
fied for the program and how they used 
screening techr\iques, assessment 



techniques, counselmg, instructional 
methods, and overall approaches to 
the provision of vocational educa- 
tion to the handicapped. In addi- 
tion, both at the state and local 
levels, the perceptions of adminis-^ 
trators regarding "mainstreaming" 
<the mtegration^ tif ^andiCxHp>pe4 stu- 
dents with the non-handicapped), 
revenue sharing, and the overall value 
of the set-aside program were ob- 
tained. Finally, the attempt was made 
to identify local policies regarding 
educational services for the handi- 
capped, and to document the extent 
of local planning for the set-aside 
program. 

Definition of Project 

For the purposes of this study, the 
term "project" was defined as a Part 
B set-aside grant to a 'school or local 
education agency for the purpose of 
providing specific educatiopal ser- 
vices to the handicapped Block grants 
to local education agencies for non- 
specified services were not consid- 
ered projects. Projects had identify- 
ing "project numbers," were designed 
to serve a stated number, of handi- 
capped students, and had time peri- 
ods generally equal to those of the 
school year, e g , September 1973 
to June 1974 Projects were broken 
down in the following four categories: 

(1) Regular, Handicapped students in- 
tegrated into regular vocational edu- 
cation classes with non-handicapped 
students 

(2) Special Handicapped students en- 
rolled In special classes for handi- 
capped students only 

(3) Combination, Handicapped stu- 
dents enrolled part of their time in 
special classes and part In regular 
classes, but who received extra sup- 
port in the regular classes as well 
as the special 

(4) Other: Programs for the develop- 
ment of curricula or the training of 
teachers and other personnel 

Only the first three types of projects 
were considered In selecting the sam- 
ple project. No projects for curricula 
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development or the traming of teach- 
ers were included in the sample of 92 
projects. 

Statistical Overview 

The search for statistical data at the 
local level was^ more successful than 
_,§iJJl® _state Jey e^l^_biLj t_ e ve n at J he _ 
local level, data considered critical 
to the assessment were not readily 
available. Researchers were forced 
to review enrollment and fiscal rec- 
ords, student rosters, and other in- 
formation sources m the 'attempt to 
collect and tabulate such data as: 

(1) Enrollment by handicapping con- 
d ition 

(2) Enrollment by sex and racial and 
ethnic background ^ 

(3) Enrollment by occupational offer- 
ing 

(4) Fiscal information, including local 
contributions 

(5) Outcomes information, including 
dropouts, completers, and placements 

(6) F6lIoW'up data 

The search was not always success- 
ful Enrollment by handicapping con- 
ditions was not available for 20 per- 
cent of the 92 projects Complete out- 
comes information was available for 
only 20 of the projects included in 
the representative subsample (74 of 
the 92 projects), and per-enroHee and 
per-completer costs could be com- 
puted for only 25 of the representa- 
tive projects. 

Nevertheless, the statistical over- 
view revealed some interesting in- 
sights regarding the operation of 
the set-aside program m the 19 states 
which were included in the represen- 
tative sample It should be remem- 
bered that the sample of 92 projects 
was divided into two subsamples (1) 
74 projects In nineteen states which 
were representative of alt projects 
operating in those nineteen states, 
and (2) 18 projects in three low en- 
rollment states and California Unless 
otherwise indicated, the statistical 
information presented below relates 
to the ''represeoiative" sample. 



Mainstreammg. Nearly 70 percent of 
the projectsjncluded in the represen- 
tative sample were categorized as 
"special," indicating that integration 
of the handicapped with regular stu- 
dents is still more a^goal than a reality 
Work experience. Twenty percent of 
-^he-projec(s were prtmartly work ex- 
perience ^ograms (that is, all or the 
majority oKjhe students enrolled in 
these projects were placed in part- 
time jobs thay were either related or 
unrelated to/he instruction they were 
receiving in school). However, in an 
additional 30 percent of the projects, 
some students (usually a small minor- 
ity) were referred to work experience 
classes. The quality of the wbrk ex- 
perience provided is discussed in 
connection with the "Instructional 
Program." 

Enrollment by handicapping condi- 
tion. Approximately 77 percent of all 
students enrolled in the 74 represen- 
tative projects were classified as 
"mentally retarded." Of these, 12 per- 
cervi were classified as Jrainable 
mentally 'retarded, ' 15 percent were 
classified as ' p^hysicaliy disabled," 
and the remainder were classified 
as follows 'learning disabled' (4 
percent) and 'seriously emotionally 
disturbed," "educationally handi- 
capped," and "multihandicapped 
(1 percent each). 

National figures on the incidence 
of handicapping condition for school 
children between the ages of five and 
19 (1968-69) revealed that if the cate- 
gory ' speech impaired ' were elimi- 
nated from the total, 89 percent of the 
children were in the following cate- 
gories, mentally retarded (35 percent), 
emotionally disturbed (31 percent), ai*td 
learning disabled (15 percent). These 
three categories accounted for 85 per- 
cent of the enrollment in the 74 repre- 
sentative projects, however, the inci- 
dence of mental retardation in the 
set-aside program (77 percent) was 
much higher than the national inci- 
dence figures. 
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Enrollment by sex and racial and 
ethnic background Approximately 
60 percent of the students enrolled 
in the 74 representative projects were 
men, 55 percent were white, 37 per- 
cent black, and the remaining 8 per- 
cent Spanlsh-surnam^ed. Oriental, and 

- Amenca n-fndtan: - 

It should be emphasized that none 
of the data summarized above was 
readily available to either project ad- 
ministrators or researchers The data 
had to be processed on ^ite by means 
of record searches and detailed ques- 
tioning of project directors Thus, tt 
seemed clear that problems relating 
to /he accuracy and completeness 
of/national and state data on the 
Pa>^ B set-aside program for the 
handicapped originated at the local 
level. The diverse methods used for 
funding projects, the lack of use of 
common definitions for key terms 
and handicapping conditions, and 
most important of all. the apparent 
lack of responsiveness at all levels 
to the need for monitoring and evalu- 
ation combined to create a manage- 
ment information system that was 
at best incomplete and at woxst 
nonexistent. 

This "lack of responsiveness" may 
have been due to the absence of re- 
sources necesSciry for the collection 
and processina of fiscal and program 
data, but irre^ective of the reasons, 
It will probably take action- at the 
federal level to improve the overall 
system It is doubtful, however, that 
such action will be fruitful unless 
state and local administrators are 
consulted before improvements ar^ 
instituted The goal should be to aid 
local administrators in generating the 
kinds of information they need to 
mairitain control over thejr programs 
If thp requirements of local adminis- 
trators are satisfied and if local ad- 
mmistrators understand the need 
for collecting complete and accurate 
data on their programs, it follows that 
state and national requirements wil) 
also be met. 



Policy and Planning 

Prior to the 1968 an^endments. pol- 
icy regarding education for the handi- 
capped was not a primary concern 
of educators at either the state or 
local levels. Since the amendments, 
state and local education officials 
HFiave been forcec^to devote some at- 
tention to the handicapped. Class 
action suits in behalf of the handi- 
capped and' universal education leg- 
islation in some states have increased 
the pressure on local and state edu- 
cators to provide comprehensive edu- 
cational services for the handicapped. 
Because of these developments, over- 
all policy toward providing educa- 
tional services to the handicapped, 
including vocational education, ap- 
pears to be emerging. However, clearly 
articulated policies and corrdinated 
planning have not yet occurred in 
most areas, although some local areas 
are more advanced than others. 

One of the problems appears to be 
the fragmentation of educational agen- 
cies into special units^ each with its 
own private line to funding sources 
at the state and federal levels. Na- 
tional vocational education adminis- 
trators talk to state vocational edu- 
cation administrators, who in turn talk 
' to their local counterparts. The same 
IS true with special education, re- 
search divisions, and other units. The 
result IS that vocational education 
programs for the handicapped are 
funded on an ad hoc basis, without 
policy and planning guidelines to 
aid lh6se charged with initiating 
projects. While there can be no doubt 
that the resulting projects have been 
of benefit to the handicapped, most 
local education agencies have no way 
of knowing how many of their handi- 
capped students are being served 
and the adquacy of the program mix 

Project Administration 

The amount of 'Part B set-aside fiends 
that were allocated to indrndunl proj- 
ects constituted a ^rwinor proportion 
of all funds administered by local edu- 
cation agencies and schools. Perhaps 
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for this reason, tt was relatively easy 
for local education agencies and 
schools to absorb the administrative 
costs of the Pact B program Certainly 
the vast majority of Part*B set-aside 
funds, expended between fiscal years 
1972-73 and 1973-74, were spent for 
direct services for the handicapped. 
This was one of the most positive find- 
ings of the project level assessment 
Allocation of resources Data regard- 
ing the allocation of resources, by 
cost category, were collected for both 
school years 1972-73 (the base year) 
and school year 1973-74 Data regard- 
ing schooJ year 1972-73 were presum- 
ably complete, whereas cost figures 
for school year 1973-74 (which was 
still in progress at the time the study 
took place) were " anticipated" cost 
figures Nevertheless, comparisons 
between the complete 1972-73 fund 
allocations and anticipated 1973-74 
allocations resulted in highly signifi- 
cant findings 

1 Both complele (1972-73) and antici- 
pated' (1973-74) cost breakdowns in- 
dtcated that approximately 93 percent 
of ail known funds allocated for the 
program were used to provide direct 
services to the handicapped 

2 In 1972-73. federal funds accounted 
for 74 percent of total expenditures, 
the corresponding figure 'for 1973-74 
was only 58 percent, indicating that 
the Part B set-aside program had an 
accelerating effect on state and local 
contributions for vocational educa- 
tion programs for the handicapped 
Organizational structure Part B set- 
aside programs were for the most 
part absorbed into the already exist- 
ing organizational structures of the 
schools m which they took place This 
IS the major reason why the cost of 
administering the program was so 
low On the other hand, the absorption 
of set-aside programs into traditional 
administrative structures tended to 
diffuse their special missions The 
handicapped program was just an 
other "special" program the schools 
had to administer The amount of 
funds received by a single school to 



carry out a project" constituted such 
a small percentage of all funds ad- 
ministered by the school (and were 
subject to year-to-year federal appro- 
priations) that priority given to the 
handicapped program was generally 
no higher (and often lower) than pri- 
oisties given to other programs ad- 
ministered by the schools. 
Staffing. Personnel whose salaries 
were paid by set-aside funds were 
primarily instructors — either voca- 
tional education instructors for skills 
training, or special education teach- 
ers for prevocational training, Fupds 
were also spent for evaluators" in 
diagnostic centers and for parapro- 
fessionals and teachers' aides. 
Use 6f nonproject staff and support. 
Most prQjects were self-contained,- 
i.e , whatever services were provided 
to the students were provided by the 
projects themselves without he(p from 
outside organizations. 
Staff training. In all projects.^ncluded 
in the sample, staff trainin^^was ac- 
complished informally. However, most 
school districts encouraged staff to 
attend university courses, state semi- 
nars, AMIDS programs, and other 
training opportunities, and provided 
released time for such training. 
Relationship between vocational edii- 
cation and special education One 
of the most significant findings of 
the administrative assessmei^t was 
that the relationship between\ voca- 
tional education and special educa- 
tion at the local level was so ct^e 
that It was often difficult to (distinguish 
between them Considering that tlje 
two agencies often appeared to be 
separate Baltic states ' at the state 
level, this came somewhat a^ a sur- 
prise. In hindsight, however, it be- 
came clear how the two grew so qlose 
together. First, the organizational 
relationship between the two agen- 
cies was quite different at the local 
level, both reported directly to the 
same superior — the superintendent 
of schools — and both were con- 
cerned with the implementation of 
actual programs. State and national 
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administrators were once- and twice- 
removed from the firing line, " thus 
bureaucratic concerns were more apt 
to take precedence over program con- 
cerns. At the local level, bgth agencies 
found themselves mutually dependent 
upon each other The result was that 
old differences began to disappear as 
both sought to provide services for 
handicapped students. 
Reportmg requirements. Consicfering 
the lack of program information avail-i> 
J "sible at the local level, it was not sur- 
prisia^ that reporting requirements 
imposed on project administrators 
" by principals and by local education 
agencies and>5t^te administrators 
were minimal. Usually the only reports 
required to the states were fiscal Sel- 
dom were, outcomes and follow-up 
reports required at any level. Thus, 
whatever outcomes and follow-up 
records were kept depended solefy 
upon the initiative of project admin- 
istrators 

Issues State and local administra- 
tors, project drrectors, counselors, 
and instrugtors' were asked to com- 
ment on the following issues. 
\ (1) The effect of the Part B set-aside 
fundfe on vocational programming 
for the handicapped 

(2) What the effect of revenue sharing 
might be on progams for the handi- 
capped * 

(3) The efficacy of integrating the 
handicapped with non-handicapped 
students 

(4) Whether increased opportunities 
for work experience programs could 

"be developed for the h?indicapped 
The latter two*"'issues ' are discussed 
in more detail in the section on the 
instructional program belowi the opin- 
ions of the educators interviewed on 
* all four issues are summarized in this 
section 

1 Port B set-aside Virtually all re- 
spondents (three state directors of 
vocational education dissented) mam- 
tamed that without the set-a^ide pro- 
gram, vocational education for the 
handicapped would be for all intents, 
and purposes nonexistent. 



2. Revenue sharing. The consensus 
was that revenue sharing would have 
a negative effect on vocational pro- 
gramming for the handicapped. The 
explanation was that entrenched spe- 
cial interest groups (most of whom 
r&present nonminority groups — or 
the loudest minorities) would see to 
It that funds that would otherwise 
have gone to the handicapped would 
be siphoned off for other purposes 
3 Integration of the handicapped 
All but a few state administrators and 
two-thirds of the local educators in- 
terviewed said that it was the policies 
of their states and school districts to 
integrate the handicapped into regu- 
lar classes However, implementation 
was far from ^ reality One of the 
major reasons cited for the lack of 
implementation was that it Is easier 
to account for funds spent for "spe- 
cial" classes than it is for funds spent 
for "regular" classes Other reasons 
cijed were the reluctance or inability 
of teachers to accept (or teach) handi- 
capped students, and the need of 
some handicapped individuals for 
special services that were not avail- 
able m regular classrooms 
4. Work experience: The general con- 
sensus of all administrators inter- 
viewed was that work experience com- 
ponents should be initiated for the 
handicapped, and many school dis- 
tricts were astdnishmgly successful 
in pro'motmg work experience situa- 
tions for their handicapped students. 
The major constraints mentioned, 
which limited work experience com- 
ponents, were (a) the reluctance of 
employers to hire handicapped mdi- 
vid^uals, and (b) the limited abilities 
of some handicapped students. 

The Instructional Program 

Judging from the results obtained 
from the 92 projects included m the 
project sample, there were wide vari- 
ations m both the type and^quality of 
projects funded throughout the coun- 
try under the PauFi B 'set-aside legis- 
lation The goals of programs included 
at least the following diagnosis and 
assessment, prevocatlonal training. 
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provision of counseling services, ap^ 
quisition of special equipment, and 
of course,, skills training The cl/en- 
tele ranged from the severely Men- 
tally retarded and emotionally dis- 
turbed to high-level (or borderline) 
educable mentally retarded individ- 
uals The teaching techniques varied 
from rudimentary to highly sophisti- 
cated, and the training that teachers 
received in serving the handicapped 
ranged from nonexistent (for most 
vocational instructors) to graduate 
degrees in special education (for some 
special education personnel). Projects 
were regular, special, and a combina- 
tion of the two and they were operat- 
ing in depressed rural areas and sub- 
urban ^d urban areas with varying 
unemployment rates and industrial 
mixes For example, the instructional 
content ran the gamut from a program 
in New York City to teach trainable 
mentally retarded students how to 
travel on the subway to a highly 
sophisticated skills training program 
in the suburbs of Detroit for students 
with several different types of handi- 
_caps 

Indeed, the variations encountered 
in the field were so great that it was 
impossible to synthesize the 92 proj- 
ects into categories of vocational 
programming for the handicapped, 
and in some ways, the overall pro- 
gram defied analysis — statistical or 
otherwise Nevertheless, some of the 
rr)o}e important issues for the future 
were identified during the course of 
the assessment of the instructional 
program 

Selection and refercaL The most im- 
portant findings regarding the selec- 
tion and referral process were as fol- 
lows* 

1 The evaluation and classification 
of students by handicapping condi- 
tion generally occurred lorig before 
tl:^e students were referred into the 
vocational program 

2 Student aptitude assessments were 
occasionally (but not always) per- 
formed by vocational educators 

3 The most common sources of re- 



ferrals for projects in comprehensive 
and vocational high schools were 
special education classes either in 
the high schoo|s or in the elementary 
schools of the school districts Stu- 
dents enroH^d in , regular classes 
were sometinjies referred to the proj- 
ects by instructors and/ or guidance 
counselors, but they constituted a 
minority of the enrollment in the over- 
all program In institutions for the 
handicapped, students already en- 
rolled were placed in the set-aside 
projects. Sheltered workshops en- 
rolled students from institutions, spe- 
Qial education classes, and in a few 
cases, youngsters who were not en- 
rolled in schools, or students who had 
completed skills training programs 
but were not yet ready for outside 
employment. 

4 The classification of students m 
mentally handicapped categories (ex- 
cept fot- trainable mentally retarded) 
was a source of tension to educators, 
students, and the general public. The 
use of IQ tests to measure mental re- 
tardation was being challenged m 
many areas by minority groups and 
their advocates. The trend was to- 
ward categorizing all handicapped 
students (as well as disadvantaged 
students) into a special needs cate- 
gory (HR 69, which permits parents 
access to school records will prob- 
ably cause an acceleration in this 
trend.) 

5 In many areas, especially depressed 
rural areas, there was a tendency to 
ignore distinctions between disad- 
vantaged" and "handicapped" stu- 
dents 

It should be emphasized that most 
of the personnel interviewed m con- 
nection with the project level assess- 
ment were project," or vocational 
education administrators and instruc- 
tors. Their knowledge of the evalua- 
tion and diagnosis process was at 
best superficial. It was therefore not 
possible to assess the evaluation and 
diagnosis process in depth. However, 
regardless of how special needs 
students may be classified (handl- 
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capped, disadvantaged, and so an), 
those referred to the vocational pro- 
gram should undergo further assess- 
ments to determine aptituc/es and 
educational needs Such aptitude 
assessments — which-^re a voca- 
tional education responsibility — were 
not conducted m most project^. 
.Curriculum and teaching methods 
Nearly all of the instructors who were 
interviewed expressed a theoretical 
commitment to individualized instruc- 
tion, but as with mamstreaming, 
4hat commitment had not yet been 
translated into action — except to the 
extent that hands-on vocational 
trai/iing (which l^y its very nature is 
'indiyidualfzed) was-practiced. The rea- 
sons for this discrepancy were that 
most classroom teachers did not have 
the time to develop their own matenal, 
nor did they have access to materials 
already developed Why the latter is 
true was unclear, but it was seldom 
that state-developed curriculum ma- 
terials were found at the project level. 
This lack ofjndividualized instruction 
throughout the set-aside program may 
be pne of the major reasons that de- 
spite policies to the contrary, handi- 
capped students were placed for the 
most part in special rather than regu- 
lar classes. ^ 

Occupational offerings. Xhe d^finr--. 
tion of vocatipnal education contained' 
* in the 1968 amendments is in part^as 
follows , 

vocational or technical training or re- 
trainirtg which is given in schools or classes 
(including field or Taboratory work'and 
remediakor relaterd academic apd teclj- 
nical instructfon- incident ttiereto) urvler 
'publ»S supervjsibn and control or i/nder 
contract with a state board or local edu 
cation agency and is conducted as part 
of a program designed to prepare 
viduafs for gainful employment or i^enrih 
skilled or skilled workhrs or techni5ians 
or subprofessionals in recognized bcQiJ- 
pations (emphasis added) 

* This larnguage indicates that voca- 
tional education for the handicapped 
means "skills training." or training for 
, "gainful employment'' in skilled, semi- 
skilled, or' technical positions How- 



ever, data taken from class enrollment 
figures for all 92 projects indicate 
that 63 percent of the handicapped 
students enrolled in set-aside pro- 
grams were in nonskills training 
courses. Of these, 52 percent vyere 
enroHed in prevocational courses* 

The other than skills training" cate- 
gory includes, in addltion.to prevo- 
cational training, the following mo- 
bility instruction, evaluation, travel 
training, sheltered workshops (other 
than as<work experience stations), in- 
dustrial arts, and tutoring Nongainful 
home economic cypurses (mainly for 
women) Included sowing, home cook-, 
ing. and homemaking, 

ThiS' raises the question as to 
whether set-aside funds were in most 
instances being used to fulfill the 
intent of the Act For example, should 
nonskills training courses be financed 
with vocational education funds or 
with other funds appropriated for the 
handicapped'? The answer to this 
question depends to a great extent 
upon the types of handicapped indi- 
viduafs who are referred into the pro- 
gram If trainable mentally retarded 
individuals are referred to the voca- 
tional education program — 12 per- 
cent of the total enrollment was classi- 
fied as "trainable" — skills training 
may not always be possitrle The s^me 
IS tC'ue iA^ith^senously educable men- 
tally retarded students who were often 
enrolled in sheltered workshops, and 
to many students who were classified 
as seriously emotionally disturbed 
and learning-disabled 

These issues reflect an absence-. of 
planning at any levQl for overall edu- 
cational services for the handicapped 
It would seem that the first priority of 
^ the set-aside program should be Jo 
provide skills training for handicapped 
iftdivifJuals -who, although they Imay 
need special Educational services to 
succeed in vocational educatiom' pro- 
^grams, were judged capable of com- 
peting on the open labor market with 
non-handicapped individuals. If vo* 
cational education were to serve this 
target group, other funds (special 
education funds, for example) could 



be used to provide nonskills training 
for those who are not, and never v^ill 
be, capable of competing on the open 
labor market. However, if this were 
to happen, it would necessitate co- 
ordinated planning, from the local 
to the riational level, involving such 
agencies as special education, voca- 
tional education, research and statis- 
tical units, vocational rehabilitation, 
and perhaps others Such planning 
was not taking place in most of the 
areas visited m conjunction with the 
project leverassessn\^nt 

The courses in tff^ 92 projects 
ranged over the entire spectrum of 
vocational education offerings, but^ 
the largest numbers were m the trade' 
and industrial category (primarily 
male), home economics (primarily fe- 
male), and prevocational (primarily 
younger students) As m other pro- 
grams, the range of training was con- 
siderably wider for men than for 
women Most female students were 
enrolled in home economics, health 
occupations, and prevocational train- 
ing The remainder was scattered 
throughout distributive education and 
office and clerical classes. Of course, 
the number of occupational offerings 
included in the trade and industrial 
category is much larger than the num- 
ber of occupations in the home eco- 
nomics and health accupatlons cate- 
gories This factor, more than any 
other, accounted for the wider range 
of occupational training for men 
Work experience. Approximately 25 
percent of the students enrolled in 
the 92 projects were m work experi- 
ence programs, that ig, they spent 
part of their time in school and part 
of their time on a job However, only 
one of the 92 projects was a coopera- 
tive program, that is, the work the 
students were performing on the job 
was related to the instruction they 
were receiving in the classroom Most 
of the jobs being performed by handi- 
capped students were "work experi- 
ence" or "income maintenance" posi- 
tions, they were not related to the 
instruction they were receiving in the 



cfassroom. Many of the work stations 
were m sheltered workshops, and 
most^.of those in private firms were 
jobs requiring limited skil^ 
Mixmg the handicapped with the dis- 
advantaged. There was a trend, espe- 
cially in rural areas, to mix the handi- 
capped and the disadvantaged in the 
same classes Some administrators 
justified this on the ground that if 
they did not mixVlhe two together, 
there would not be enough students^ 
in either category for the school to 
qualify for state grants. However, in 
most cases, the educational needs of 
the two groups were quite different, 
and m almost every case, there was 
no doubt that those classified as dis- 
advantaged resented being placed in 
classes with those categorized as 
mentally retarded This was espe- 
cially true m large cities where the 
disadvantaged were members of 
minority groups and the mentally 
retarded were not If both the dis- 
advantaged and handicapped were 
referred to regular classes, there 
was no problem, but where they were 
grouped together in special classes, 
the atmosphere — for the disadvan- 
taged, at least — was not conducive 
to learning 

Guidance and counseling. Only a few 
of the^ larger projects paid for guid- 
anca,and counseling personnel from 
projew^funds. Most students enrolled 
in the set-aside program had other 
school attachments and, theoretically 
at least, had access to the regular 
school guidance and counseling staff 
Within projects, project directors and 
work experience coordinators were 
most likely to serve as surrogate 
' counselors. The instructors of spe- 
cial classes and prevocational courses 
were more likely to deal with the indi- 
vidual problems of their students than 
the instructors of regular classes 
Equipment and materials' Ihe qual- 
ity of equipment and materials did 
not appear to be a major concern to 
most project personnel. Most rated 
available equipment as "adequate" 
or better. This may be due to the fact 
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that the majority of students was m 
the educable mentally retarded cate- 
gory and used the same equipment 
provided ,for regular classes Most 
pnysical and sensory handicapped 
students were enrolled in institu- 
tions, which in most cases, were ex- 
cellently equipped to deal with spe- 
cific handicaps 

Program costs and outcomes. Pro- 
gram costs could b^spalculated for 
25 of the representative projects, and 
outcomes information was available 
for 20 of the representative projects. 
The cost information for the 25 proj- 
ects IS as follows 

Category Number Cost 

(1) Total 
enrollment 2.749 

(2) Total 
completers 1.456 

(3) Total com- 
bined costs 
(federal, 
state, and 

local) L $3,491,001 

(4) Total fbderal 

costs 1.268,090 

(a) Combined 
costs per 

enrollee 1,270 

(b) Federal 
costs per 

enrollee 462 

(c) Combined 
costs per 

completer 2,398 

(d) Federal 
costs per 

completer 871 
Outcomes information Of the 2.009 
students enrolled in the twenty proj- 
ects for which outcomes information 
was available, only 6 percent dropped 
out, 57 percent completed, and 48 per- 
cent of the completers were placed in 
jobs. 58 percent of which were train- 
ing related. Approximately 33 percent 
of the completers reenrolled m regu- 
lar vocational education programs 
or in other training 

Because of the sparsity of outcomes 
information, it was not possible to 
compare completer or placement 



rates by type of training received, nor 
was It possible to compare the costs 
of various types of programs. However, 
the case study interviews (summa- 
rized in the next section) jndicated 
that work experience qompleters 
earned more in the jobs they ob- 
tained than those who were not in 
work experience programs. The em- 
ployer interviews indicated that one 
of the major constraints limiting the 
expansion of work experience pro- 
grams is that many employers believe 
that if they hired the handicapped, 
they would have to make major 
changes in their work environments. 

Case Study Interviews 

The case study inteviews indicated 
that both students and parents ex- 
pressed extremely favorable attitudes 
toward the projects in which they or 
their children were enrolled. If one 
judges solely in terms of expressed 
attitudes, the Part B set-aside pro- 
gram for the handicapped appeared 
to be a success 

1 Student assessment. Student evalu- 
ation of the program was fundamen- 
tally good. Most liked the training 
they received and the people with 
whom they associated. They found 
that tools and equipment were not 
too hard to operate, classes were not 
boring, and the environment was gen- 
erally\favorable m terms of teachers, 
classrnates. and working conditions. 
2. Parent assessment: Of the parents 
interviewed, 76 percent rated the pro- 
grams either "excellent" or "good " 
Two out of three parents perceived- 
their children as having improved in 
the areas of self-reliance, self-image, 
and social mixing abrlity since the 
children had begun participating in 
the program. 

Because of the absence of a control 
group, it was impossible to determine 
whether the project participants in- 
terviewed were more successful in 
finding jobs than their handicapped 
counterparts who did not partici- 
pkaMli" the program Nevertheless, 
the outcomes information appears 
to* be favorable 
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0 

1 Four out of 1 0 completers who were 
still enrolled in school were employed. 

2 Six out of 10 completers who were 
no longer in school were employed 

3 The average wage received by com- 
pleters out of school was $2.17 an 
hour, the corresponding figure for 
completers in school was $2.07 an 
hour 

4 Of the employed completers, 70 
percent were in service occupations 
(41 percent), miscellaneous occupa- 
tions (18 percent), and clerical and 
sales (11 percent). 

5 Eighty-four percent of the complet- 
ers were employed in the following 
industries miscellaneous service (36 
percent), trade (20 percent), govern- 
ment (14 percent), and manufactur- 
ing (14 percent) 

6 Work experience students earn 
more than those not enrolled m this 
type of program, although the place- 
ment rates for the two groups are 
about the same 

Participating employers expressed 
favorable attitudes toward the pro- 
gram Three out of four participating 
employers rated the performance of 
handicapped students and/or com- 
pleters "as good" or "better than" 
regular workers in each of eight per- 
formance scales. 

Nonparticipating employers were 
not quite so disposed to be in favor 
of the program as their participating 
counterparts 

1 Of the nonparticipating employers, 
52 percent had negative feelings about 
participating in the program 

2 When compared to participating 
employers, nonparticipating employ- 
ers were more likely to believe that 
hiring handicapped individuals would 
require significant changes in their 
business erivironments. 

3 Sixty~one percent of the nonpar- 
ticipating employers had heard of« 
the program and 14 percent had pre- 
viously participated in it 

4 Only 16 out of a total of 71 nonpar- 
ticipating employers had been di- 
rectly approached and refused to 
participate 



The interviews also revealed some 
interesting attitudes on the part of 
students toward different types of 
programs. For example, students in 
regular classes were more apt to ex- 
press favorable opinions regarding 
their relationships with teachers and 
classmates,* yet they were more apt 
to be bored than students in special 
classes. Students in sheltered work- 
shops expressed above-average dis- 
like for working conditions," in- 
structors (or supervisors), and their 
fellow students (or workers). The per- 
centage of sheltered workshop stu- 
dents who could find nothing good 
to say about their programs (10 per- 
cent) was twice as high as for partici- 
pant sample as a whole Yet students 
in sheltered workshops were less apt 
to be bored than their counterparts 
in other classes Finally, students in 
state institutions expressed above- 
average dislike for their programs. 

CONCLUSIONS OF THE ASSESSMENT 

As was stated in the introduction to 
this report, the study conducted by 
ORG was an d^ss%ssm%ni not an ev^a/u- 
af/on of the Part B set-aside program 
for the handicapped Yet it is inevi- 
table that the study's conclusions 
contain, or at least /mp//, value judg- 
ments, some of which are favorable 
to the program and some of which 
are not. We have therefore attempted 
to bolster the conclusions summar- 
ized below with as much hard data 
as possible Nevertheless, we recog- 
nize that some of the issues raised 
by the study ar§ not only compli- 
cated, »but emotion-packed, and that 
they do not lend themselves to easy 
solutions It IS our hope that the 
findings, conclusions, and recom- 
mendations of the assessment will 
be of use in improving a program 
which already has proved its value 
in making available new educational 
opportunfties Jto handicapped stu- 
dents throughout the country The 
conclusions are arranged in four 
categories general, administrative, 
program, and issues 
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GENERAL 

Nearly 400 admmtstrators, instruc- 
tors, and other staff were mterviewed 
m conjunction withKthis study The 
almost unanimous opmjon of the re- 
spondents was that without the Part 
B set-aside legislation, there would 
be very little vocational programming 
for the handicapped in any state This 
opinion was supported by hard sta- 
tistical data 

Effect of the Part B Set-Aside Concept 

Fiscal year 1973 data reported by the 
states to the U S Office of Education 
indic|j[ed that m 17 states there were 
no differences between total voca- 
tional education expenditures for 
the handicapped and total expendi- 
tures under the Part B set-aside In 
all but a few states, the differences 
were not significant. Data from the 
project level assessment show that 
during school year 1972-73, federal 
funds accounted for 74 percent of 
all funds (federal, state, and local) 
spent on set-aside programs Equally 
Significant, during school year 1973- 
74 the percentage of federal expendi- 
tures for set-aside programs dropped 
from 74 to 58. indicating that the 
set-aside program may be having 
an accelerating effect on state and 
local contributions to vocational 
education programs for the handi- 
capped \ 

Do Set-Aside Funds Reach ' , 
the Handicapped? 

An analysis conducted of the alloca- 
tion of set-aside funds, by cost cate- 
gories, indicated that in both school 
years 1972-73 and 1973-74, the vast 
majority of set-aside funds was used 
to provide direct services to the 
handicapped Of these funds. 93 per- 
cent was used to hire staff who work 
directly with handicapped students or 
who purchase equipment, materials, 
and supplies Only 7 percent was used 
for administrative purposes 



Program Constraints 

Both state and local administrators 
cited the lack of trained staff and the 
reluctance of instructors in regular 
classes to accept the handicapped 
as the major constraints limiting the 
expansion of vocational education 
programs for the handicapped How- 
ever. It IS obvious that if the set-aside 
program were to be discontinued, 
the number of vocational training 
opportunities for the^ handicapped 
would suffer a drastic decrease. In 
other words, lack of funds," or the 
reluctance to spend funds for voca- 
tional programming for the handi- 
capped, may be the major constraint 
limiting expansion of vocational edu- 
cation j)rograms for the handicapped 

Overall Performance 

Costs and outcomes data were seri- 
ously deficient at both the state and 
local levels However, according to 
what little data were available and 
to the results of the student, parent, 
and employer interviews, the program 
appeared to be working well Costs 
per student and completer were not 
excessive, and placement rates ranged 
from 48 to 60 percent for completers 
Considering that about 33 percent of 
the completers reenrolled in school, 
one can see that the placement rate 
was good Only 15 percent of the 
completers were unemployed, and 
the dropout rate, at 6 percent, was 
very low It should be emphasized, 
however, that costs ar/d outcomes 
analyses were possible for only about 
a third of the projects included in the 
representative sample. 

Both parents and students were 
favorably impressed by the program, 
and participating employers gave their 
handicapped employees high ratings 
in almost every work performance 
category 

ADMINISTRATION 

The administrative aspects of the 
program are discussed below. 
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Policy 

Clear and articulate policy issuances 
directed toward providing compre- 
hensive educational services for the 
handicapped, including vocational 
education, were lacking at both the 
state and local levels. Because of the 
enactment of the set-aside "program, 
nght-to-education suits, and universal 
education legislation in some states, 
state and local education agencies 
were becoming more aware of their 
responsibilities toward the handi- 
capped Yet most states and local 
education agencies were reacting to 
these developments, rather than act- 
ing to create comprehensive educa- 
tional programs for the handicapped. 
What are nee^Jed most are policy 
issuances directing the various edu- 
cational divisions with Responsibility 
for the handicapped to work together 
in creating such programs The frag- 
mentation of educational agencies 
into special units, each with its own 
private line to funding sources at the 
state and federal levels, is one of Jhe 
major inhibitors to comprehensive 
educational programming for the 
handicapped It is unrealistic to ex- 
pect divisions of vocational and spe- 
cial education to initiate such policies, 
They must emanate from the highest 
levels of the educational hierarchies 

Planning 

It would be an exaggeration to state 
that no planning takes place at the 
state and local levels, but it is accu- 
rate to maintain that what planning 
does take place is of a short-term 
nature, generally directed toward 
justifying certain projects It would 
be unfair to place the blame for lack 
of planning solely on vocational edu- 
cation administrators It is the re- 
sponsFbility of vocational education 
to provide a specific kind of educa- 
tional service to all who are re- 
ferred to the vocational education 
program handicapped and non- 
handicapped, it is not the respon- 
sibility of vocational education to 
identify, assess, and recruit alt 



handicapped individuals coming up 
through the educational system who 
should be placed in vocational edu- 
cation programs Thus if long-range 
plans are to be launched to provide 
comprehensive educational programs 
for the handicapped, including voca- 
tional education, pertinent divisions 
of educational agencies — at both 
the state and local levels — must work 
together. 

There was little evidence of this 
kind of cooperation at either the 
state or local levels When asked 
about the universe of need, or the 
establishment of priorities, most re- 
spondents expressed bewilderment 
"Planning," if tt can be called that, 
consisted mainly of state program 
officers soliciting project proposals 
from local administrators At the 
local level, it generally consisted of 
vocational educators getting together 
with special educators to determine 
what kinds of projects should be 
funded and what types of students 
should be referred to the projects 
The object was to spend the funds 
(Part B set-aside funds) available 
from the states While there can be 
no doubt that the resulting projects 
were of benefit to the handicapped, 
most states and local education agen- 
cies had no way of knowing how many 
of their handicapped students were 
being served or if the program mix 
was adequate 

Monitoring and Evaluation 

Monitoring and evaluation depend to 
a great extent on the collection and 
tabulation of hard statistical data 
They also depend on the presenta- 
tion of such .data in a form that is 
readily understandable to project 
administrators Adequate manage- 
ment information systems were ex- 
tremely rare at both the state and 
local levels In many cases, impor- 
tant information was buried m files, 
but It was seldom that such informa- 
tion was processed for management 
purposes In addition, common defi- 
nitions for such terms as "handicap- 
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ping condition and completer 
were not used, nor were local admin- 
istrators aware of sources (federal 
and state) from which project funds 
were obtained. Complete enrollment, 
fiscal, and outcomes information was 
not available from any state and from 
only a handful of projects Little at- 
tempt was made to collect follow-up 
information Much of the program and 
fiscal data^ reported by the states to 
the Office' of Education were either 
incomplete or inaccurate. The lack of 
adequate management information, 
together with other weaknesses which 
will be discussed in subsequent sec- 
tions, resulted m poor monitormg 
and evaluation at the state and local 
levels 

Funding Procedures 

Monitoring and evaluation also de- 
pend upon whether measurable goals 
are set for programs and whether per- 
formance standards are established 
Proposals for grants from local edu- 
cation agencies to the states should 
contain such goals and performance 
standards In states which provided 
block grants to local education agen- 
cies, no such goals or standards 
existed, and the states had very little 
control over local programs In the 
majority of states which funded "proj- 
ects* on the basis of proposals sub- 
mitted by schools and local educa- 
tion agencies, goals and staodards 
generally existed, although^in many 
cases, the goals stated were too gen- 
eral to be measurable Fiscal account 
ability was much better in states which 
funded projects In the block grant 
states, local administrators did not 
apply funds from various sources 
against expenditures until after the 
close of the school or fiscal year 
Thus the use of set aside funds be- 
came a bookkeeping rather than a 
program responsibility 

Special note should be made of 
the following 

1 A few states have devised methods 
for the joint funding of projects with 
other agencies — agencies both in- 



side and outside the educational es- 
tablishment—without violating regu- 
ations against the co-mingling of 
unds Since co-mingling is often 
mentioned as a constraint limiting 
jOint funding, the accounting meth- 
ods used by these states should be 
disseminated to all state program 
officers 

2 Several states employ the seed 
money' concept in funding projects, 
that IS, set-aside funds are granted 
to local education agencies only on 
condition that over a period of time 
the projects will become 100 percent 
supported by local funds. The results 
of the seed money concept, if it proves 
successful, could have significant 
icnplications for the set-aside pro- 
gram. 

3. One of the most often mentioned 
constraints limiting the funding of 
regular projects (projects which in- 
tegrate the handicapped with non- 
handicapped students) ts that it is 
too difficult to prove that such funds 
are used exclusively to purchase ser- 
vices for the handicapped. Yet several 
3tates as a matter of policy fund only 
regular projects and have no diffi- 
culty accounting for the use of set- 
aside funds, The techniques used 
by such states should also be dissemi- 
nated to all state program officers. 

Organization 

Primarily because the Part B set-aside 
program has been absorbed into exist- 
ing administrative structures at both 
the state and local levels, the admin- 
istrative cost of the program has been 
low Although this is a positive find- 
ing, It has Its negative aspects Many 
of the administrative responsibilities 
mandated in the 1968 amendments 
were not performed, and state pro- 
gram officers became sp<icitors and 
funders of projects rather than de- 
signers of state programs. Pnonties 
given to set-aside projects at the local 
level were generally no higher (and 
often lower) than priorities given to 
other programs 



PROGRAM 

Four program components — cur- 
riculum development, teacher train- 
ing, occupational offerings, and work 
experience — are discussed below 

Curriculum Development 

Almost all instructors interviewed 
expressed a theoretical commitment 
to individualized instruction, but in 
most areas that commitment had not 
yet been translated into action »v ex- 
cept to the extent that 'hands-on" 
vocational training (which by its very 
nature is individualized) was prac- 
ticed. 

Most projects in states which suc- 
cessfully implemented policies di- 
rected toward ■mamstreammg" the 
handicapped (that is, placing them in 
regular classes with the non-handi- 
capped) used individualized instruc- 
tion techniques and advanced cur- 
ricula Thus the failure to effect 
mamstreammg in most areas may be 
partially due either to the nonuse of 
existing curriculum materials or the 
lack of such materials 

Teacher Training 

One of the most often mentioned con- 
straints limiting the expansion of vo- 
cational education programs for the 
handicapped was the reluctance of 
teachers in regular classrooms to ac- 
cept the handicapped, or the inability 
of teachers to instruct handicapped 
students. Thus teacher training in 
special education techniques was 
considered a necessity, not only to 
help-effect program expansion, but 
also to improve program quality 

Occupational OHerlngs 

Two-thirds of the training provided 
under the set-aside program was non- 
skills training, that is, training not 
intended to prepare students to com- 
pete in the open labor market In any 
given skill, craft, or trade Half of 
the students enrolled In this type of 
training were in prevocational courses 
Others were enrolled in diagnostic 
centers, mobility training, nongainful 



home economics, industrial arts, tu- 
toring, and sheltered workshops. 

Of those enrolled in skills training, 
the vast majority was in trade and 
industrial courses, mainly for men. 
The range of occupational offerings 
for women was extremely narrow, 
being confined mainly to home eco- 
nomics (much of which was not gain- 
ful) and health occupations. 

Work Experience 

In half of the projects included in the 
project sample, at least some students 
were referred into work experience 
programs. Approximately 30 percent 
of the projects were classified as P^rt 
B "work experience" programs (all 
students in such programs were re- 
ceiving work experience of some 
kind) However, Parts G and H pro- 
gramming for the handicapped was 
minimal, and in most instances, the 
work stations to which handicapped 
students were assigned were not re- 
lated in any way to the instruction 
they were receiving m school, were 
unskilled in nature, and were in- 
tended mainly to provide students 
with "work experience " 

Unlike participating employers, non- 
participating employers expressed the 
belief that it would be necessary to 
effect radical changes in their work- 
ing environments if they were to hire 
the handicapped State and local ad- 
ministrators cited the reluctance of 
employers and the limitations of some 
handicapped students as the major 
constraints limiting the expansion of 
work experience programs for the 
handicapped An additional constraint 
may be that too little is done at the 
state and local levels to promote em- 
ployer participation in vocational edu- 
cation programs for the handicapped. 

ISSUES 

Approximately 15 percent of those en- 
rolled m the set-aside program were 
classified as trainable mentally re- 
tarded, seripusly emotionally dis- 
turbed and learning disabled In addi- 
tion, many of those classified as 




157 



160 



educable mentally retarded w,ere 
borderline trainables One of the rea- 
sons why so much of the training 
provided under the Part B set-aside 
was of the nonskill type was that 
nnany of the individuals referred into 
the program did not have the capacity 
to participate in advanced skills train- 
ing programs Some states concen- 
trated on the younger handicapped 
students, which explains why so much 
of the programming was prevoca- 
tional. 

Program Priorities 

Many administrators throughout the 
country voiced the opinion that tram- 
able mentally retarded students and 
other handicapped individuals who, 
according to medical and psycho- 
logical diagnoses, will never be able 
to compete on the open labor market, 
should not be referred to the set-aside 
program A few states established 
policies which, in effect, barred the 
placement of such individuals in voca- 
tional education programs. The ques- 
tion IS one of prionties If one con- 
siders that funding for the handi- 
capped comes from many different 
sources and that groups of handi- 
capped individuals have varying edu- 
cational needs, the question arises 
Which funds should be used to pro- 
vide which services'^ The consensus 
was that the first priority for the set- 
aside program should be those handi- 
capped individuals who, although 
they may need special services to 
succeed in a vocational education 
program, nevertheless have the ca- 
pacity to compete on the open labor 
market in certain occupational areas. 
With respect to prevocational pro- 
gramming for younger students, the 
prevocational training should be tied 
into, or lead to, later skills training 
Because of the absence of policy and 
planning at both the state and local 
levels, priorities for the set-aside 
program generally were not estab- 
lished. 



Mainstreaming 

Approximately two-thirds of the local 
administrators who were interviewed 
said that it was the policy of their 
school districts to integrate the handi- 
capped with regular students Twenty 
reported no policy m this area, and 
eleven said that they did not know 
whether such a policy existed. How- 
ever, in most areas where the policy 
called for integration, implementa- 
tion was still far from a reality. Of the 
students enrolled in the program, 70 
percent were in "special" classes 
As noted previously, there were sev- 
eral reasons for la<5k of implementa- 
tion (1) reluctance of instructors to 
accept handicapped students, (2) in- 
ability of instructors to teach the 
handicapped, (3) tack of individual- 
ized instruction techniques in most 
projects, and (4) referral (into the 
program) of individuals who could 
not succeed in advanced skills train- 
ing classes (trainabte mentally re- 
tarded^tudents, for example) 

However, there is also the question 
Is integration always the best policy'? 
There appears to be a real danger 
that handicapped students will be- 
come lost in regular classes, or that 
they will not receive the special sup- 
port they need from instructors and 
students of regular classes One of 
the findings of the student inter- 
views supports this contention, that 
IS, that students in regular classes 
were more apt to become 'bored than 
students in special classes There 
were numerous examples of special 
projects wherein handicapped stu- 
dents received vital support from 
both their fellow students and their 
instructors Perhaps the answer is 
"combination" projects, similar to 
those often funded in Michigan, Wis- 
consin, and Minnesota. Students in 
combination projects spent part of 
their time in special classes and part 
in regular classes, but they received 
extra support in both the special and 
regular components ' 



Diagnosis and Assessment 

Diagnosis of handicapping condition 
was not a voc^onal education re-^ 
sponsibility Nevertheless, the classi- 
fication of students into mentally 
handicapped categories was encoun- 
tering difficulties through,out the 
country The use of IQ scores to 
classify students as pentally retarded 
was being challenged in many areas, 
^specially by minority groups The 
trend m many states and local areas 
was fo discontinue categorizing stu- 
dents by specific types of handicaps 
and. instead, to place all handicapped 
individuals in the "special needs" 
category. 

This 'trend makes it Incumbent on' 
vocational education to perform'edu- 
cational ^sessments of the special 
needs students who are referred for 
' training Thorough educational as-^ 
sessments, including individualized 
education plans, by vocational edu- 
cation were performed in only a small 
minority of the sample projects 

Mixing tile Handicapped 
and Disadvantaged 

In smaller schools, no attempt was 
made to separate educable mentally 
retarded students from the disadvan- 
taged, and in some of the larger 
schools, disadvantaged students were 
placed in special classes with the 
mentally retarded. Since the educa- 
tional needs of the disadvantaged 
and handicapped are usually differ- 
ent, and since*the disadvantaged, 
understandably, were often humili- 
ated by being placed in classes with 
'the mentally retarded, the mixing of 
the mentally handicapped with the 
disadvantaged is indeed a question- 
able practice. 

Revenue Sharing 

Most state and local administrators 
said that revenue sharing would have 
a negative effect on vocational edu- 
cation programs for the handicapped 
and on vocational education in gen- 
eral The consensus was that en- 
trenched special interest groups 



would see to It that funds that other- 
wise would have gone to the handi- 
t:apped would be siphoned off for 
other purposes. 

RECOMMENDATIONS 

Based on the conclusions summar- 
ized above, we offer the following 
recommendations. 

1. Extension of the Part B set-aside. 
Despite administrative and program 
deficiencies, the Part B set-aside pro- 
gram has proved its worth in making 
available new educational opportu- 
nities to handicapped students, and 
It should be continued. 

a. Set-aside for all special-needs 
students: Set-aside provisions for 
ihe handicapped and for the dis- 
advantaged should not be com- 
bined. The educational needs of 
the handicapped and the disad- 
vantaged are usually different 
and should be considered sepa- 
rately. Moreover, if the two cate- 
gories are combined, there would 
be no assurance that the stat^ 
would allocate funds to the two 
groups on a proportional basis 
Therefore, one of the two groups , 
would suffer a paucity of program- 
ming in some areas 

b. Monitoring ttie set-aside provi- 
sions: There is evidence that some 
states may not be expending 10 
percent of their basic grants on 
programs for the handicapped. The 
US Office of Education should 
monitor this situation closely. 

2. Teacfier training and retraining- 
There are few persons who have been 
trained in both special education and 
vocational education. There is a need 
for undergraduate teacher education 
programs which will produce indi- 
viduals qualified In both fields. Grad- 
uate programs for training vocational 
education teachers In special educa- 
tion and vice versa are also needed 
Botfi types of programs should re- 
quire internships in Part B projects 

3 Instructional systems for the handi- 
capped: Research in the area of In- 
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structionat systerfis for the handi- 
capped IS urgently needed Basic, 
applied, and comparative research in 
this area will give a needed boost to 
instructional technology as it applies 
to ttie handicapped Many teachers 
and employers suggest that their un- 
willingness to work with handicapped 
students is related not only to their 
l^ck of knowledge regarding how 
to teach or supervise, but to a greater 
lack of societal knowledge regarding 
the needs, learning styles, and cog- 
nitive structures of persons with spe- 
cial needs This research should re- 
late directly to or take place in Part 
B programs 

4 Promotion of coordinated educa- 
tional programs for the handicapped 
Consideration should be given to 
providing some states with grants for 
pilot programs directed toward ac- 
complishing coordinated, interagency 
policy making, planning, monitoring, 
and evaluation oi all educational pro- 
grams for the handicapped, including 
vocational education Such programs 
should include identifying the uni- 
verse of need in local areas and for 
the state as a whole, identifying funds 
from all sources available to meet 

^those needs, establishing priorities 
based on needs and available funds 
for each type of program, and estab- 
lishing management information sys- 
tems for monitoring and evaluation 
purposes 

5 Dissemination of information: The 
US Office of Education should col- 
lect and disseminate to the states 
information of value m administering 
the Part B set-aside program The 
methods used 6y some states to ef- 
fect joint funding of projects, account 
for funds used in financing regular 

. projects, and incorporate the "seed 
money' concept are examples of in- 
formation that should receive wide 
dissemination throughout the states 

6 Improvement of data collection sys- 
tems The U S Office of Education, 
IP consultation with state and local 

"educators and administrators, should 
take action to improve local and state 



data collection systems. The Office 
of Educatlon'should be particularly 
concerned with the quality of infor- 
mation on the Part 0 set-aside pro- 
gram for the handicapped that is re- 
ported to the federal government by 
the states. However, improvement of 
data collected by the states depends 
to a great extent on the quality of data 
collected at the local l^vel. The em- 
phasis, therefore, should be on the 
data local administrators need to 
maintain control over their programs. 
7. Curriculum development. Curricula 
for skills training, which would incor- 
porate individualized instruction tech- 
niques, are necessary if handicapped 
individuals are to be integrated into 
classes with the non-handicapped. 
Although a great deal of such material 
has been developed, it is not widely 
used. Evaluations of existing material 
should be made, and efforts should 
be made at the state level to promote 
the use ot superior curricula mate- 
rials in Part B set-aside projects In 
some areas, technical assistance to 
project instructors may be necessary. 
The states should be prepared to pro- 
vide such technical assistance 
8 Program mix. The amount of skills 
training provided under the set-aside^ 
program should be increased, and 
all prevocational programs should be 
tied into later skills training. Individual 
education plans should be developed 
for each student referred into the set- 
aside program. Such plans should be 
directed toward providing compre- 
hensive educational services, both 
nonskills and skills training, for handi- 
capped individuals enroHed in the 
vocational education program. 
9. Occupational offerings for women 
The range of occupational offerings 
for women in the set-aside program 
IS very n'arrow. States should take 
action to widen the occupational of;,^ 
ferings available* to women, includ- 
ing those m the trade and industrial 
area 

a. Home economics. State guide- 
lines for home economics courses 
should be reviewed to make certain 



that such courses do not preclude 
either work or laboratory experi- 
ence because of the few hours per 
'week students spend m h6me eco- 
nomics courses Many of the honne 
economics courses in which set- 
aside students were enrolled ap- 
peared to lack laboratory and/or 
, work experience As a result, they 
were listed in the ' nongainful" 
home economics category, the pro 
gram did ogt seem to be preparing 
students lor gainful employment 
in a recognized occupation " 
10. Work exper/ence^ Consideration 
should be given to allocating portions 
of Parts G and H set-asides for the 
handicapped P/ogramming for the 
handicapped under Parts G and H, 
was for all practical purposes non- 
existent 

a Employer promotion Aggressive 
campaigns to promote participa- 
tion by employers in Part B set-aside 
programs should be launched at 
botji the national and state levels 
Employers who are now participat- 
ing in the program should be en- 
listed to help in these campaigns 
The keynote should be to break 
dov^n the biases of employers who 
believe that the employment of 
'handicapped individuals would 
cause wholesale changes in their 
working environments or that su- 
pervision of the^handicapped would 
be difficult The results of the em- 
ployer interviews show that such 
changes are not necessary and that 
handicapped, workers "receive high 
ratings from participating employ- 
ers in aJL performance categories" 
Use should be made of this infor- 
mation. 

11 Enrollment pnotrity Priority for 
enrollment. in the set-aside program 
should be given to those handicapped * 
indivicJuals who. after training, can , 
compete in the open labor market in 
certain occupational areas Funds 
from other sources should be used 
to provide educatlona^ services- for 
individuals who are ur>ljkely to be 
able to compete on the open labor 



market or who are unable to benefit 
from advanced skills training Of 
course, periodic reassessments should 
be made of all handicapped individ- 
uals to make certain that those who 
make educational advances are not 
locked into set and never-changing 
programs Furthermore, if all in the 
priority target population is enrolled 
in a given, state or area, and all set- 
aside funds have not been spent, proj- 
ects for the more severely handi- 
capped, or those who may require 
services over a longer period of time 
before they can become competitive, 
should be instituted 
12 Educatiortal assessments. Al- 
thougti It IS not a responsibility of 
vocational education to diagnose and 
classify individuals by handicapping 
condition, it is a vocational education 
responsibility 'to perform thorough 
educational assessments of handi- 
capped students who are referred 
into the program The states should 
require that such assessments be 
-made for all special needs students 
who are referred to the vocationalj 
education program. * 
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Iowa Vocational Education Special Needs 
Assessment Survey 
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INTRODUCTION 

The implementation of vocational 
special needs*programs for disadvan- 
taged and handicapped students in 
lowa is administered by the Special 
Needs Section of the lowa SxHie De- 
partment of Publid Instruction (DPI). 
Support for special needs program- 
ming IS authorised at the federal level 
by the Vocational E(Jucation Act d*f 
1963, amended in 1 968, 1 972 and 1 976. 

'The 1976 Amendments, tp the Voca- 
tional Education Act cequre a mini- 
mum of 30 percent' (20% for disad- 
vantaged and 10% for handicapped) 
of each state s federal vocational allot- 
ment to be*used for providing voca- 
tional education services for disad- 
vantaged and handicapped poputa- 
tions.^ Th$ administration of that 

'federal act within the state is autho- 
rized by "The lowa State Plan for The 

, Adm'mistratiort of Vocational Educa- 
tion Within Career Education." 

In 1976 the Special Needs Section 
of DPI defined as one of its top pri- 
ority objectives the completion of a 
state-wide survey of secondary voca- 
tional ecfyc^tors to determine the 
extent to v\/|iich services were^belng 
provided' disadvantage'd and ha^rtdi- 
capped students In vocational cla^s^s 
and the areas of support which need ' 
attention. The^ development, admin-, 
istration, data^ artelysis and reporting 
of th'e fin4in§Sswe/e completed through 
a joint agreement with Drake Univer- 
sity College of Education The results 
wiil be usedl in the admirristration of 



programming as evidenced in ''The 
lowa State Plan for the' Administra- 
tion of Vocational Education." . 

Items for the survey Instrum^ent were 
developed in cooperation with the 
subject-matter consultants (Office Ed- 
ucation, Disthbuth/e Education, Voca- ' 
tional Agriculture, Homemakmg Edu- 
cation, Trade and 4ndustnal) in the^ 
Career Education branch of DPI. Once"'^ 
developed-, the survey items were 
given to 10 vocational teachers at 
four Des Moines high schools for 
further comment on clarity, utility and * 
efficiency. 

Every^effort was made to collect 
the Information requested on^ the 
survey directly from the classroom 
teacher. Survey forms were addressed 
and distributed to mdividUal' teachers 
tismg a list provided by the Manage- 
ment Information Division of DPI. That 
list consisted of over 4,000 names of 
persons who were certifiedNjp teach 
the subjects that were the focus of 
the survey. As it turned outj however, 
^ many\of those persons were indeed 
certified to teach those subjects but 
6re not doing so for varying reasons. 
The 'best estimate of the number of 
vocational teachers (as defined- by 
the survey authors) in lowa is less 
than 2,000. A large number of survey 
forms were returned with the mes- 
sage that that person is not involved 
in vocational education. 

Usable survey instruments were re- 
turned by 1,265 of the nearly 2,000 
secondary vocational educators in 
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Iowa Delivery and return of the 3ur- (1) professional bacKgrounds and 
vey instruments was done through attitudes of instructors, (2) desig- 
Ihe Area Education Agency media nation of services currently available 
delivery services That proved to be to special needs students, (3) class 
both an efficient and a cost-saving enrollment data, (4) identification of 
method, resulting in a savings of problems in dealing with special needs" 
•Si. 500 in postage alone Iowa Is di- students, and (5) identification of po- 
vided into 15 geographical mulji- tential solutions to the problems. Each 
county service areas tor the adminis- component is reported in a separate 
tration and delivery of special edu- section of this report. Data. collected 
cation, media, staff development, and are tabulated to reflect responses on 
^consultative services in other cur- the 'State level of analysis, and are 
nculum areas. These administrative simply to promote- readability and 
units are known as Area Education discussion. Other data analysis done. 
Agencies (AE A s) ^ but not reported herein include anal- 
Although the return rate varied from ysis of all information by discipline, 
a high of 84 percent from one A E A by A E A., and by size of school dis- 
10 a low 44 percent in another, the trict Questions concerning this re- 
overall return rate was 65 percent port and the availability of the raw 
That was deemed to be a sufficient data collected should be directed to 
return for the intended use of the Dr Raymond Morley, Consultant^ Spe- 
data It was not anticipa'ted that cial Needs Section. Grimes State 
any inferential statistical procedures Office Building, Des Momes, Iowa 
would be necessary to meHthe needs 50319. 
of the users It should be noted that 

all tables in this report do not total PROFESSIONAL BACKGROUND AND 
to 1.265 r.esponses In some instances ' ATTITUDES OF INSTRUCTORS 




TABLE 1 



Number of Iowa Survey Respondents by A E A 



AE A 



Number 



%of A.E A 
Voc Teachers 



% of Total 



2 
3 
4 
5 
6 
7 
9 
10 
11 
12 
13 
f4 
15 
16 



97 
66 
31 
70 
98 
58 
67 
99 
111 
217 
96 
104 
54 
58 
39 



78 2 

56 4 
43 6 
63.0 
67 1 , 

69 0 
50 7 
58 9 
58 7 

57 4 
66 2 

70 7 
84 3 
53 7 
52 0 



77 
52 
24 
5.5 
7f 
46 
53 
78 
88 
1Z.2 
76 
82 
43 
46 
30 
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TABLE. 2 



Number of Iowa Survey Respondents by^Size of School District ^ 


District t 


• 




Population' 


Numbsr 


% of Total 


145- 499 


169 > 


133 




182 


• 144 


750- 999 


144 


M1.4 


' 1000-1499 


. 145 


11.5 


1500-1999 


83 


66 


2000-2999 


138 ' 


109 


3000-over 


404 


31.9 



•Number of public school students. K-12 



cation, including Trades and Indus- 
tries and Industrial Arts, Homemaking, 
and other work related and career 
education subjects, including health 
occupations The majority of respon- 
dents were involved in the traditional 
vocational areas" of Business Educa- 
tion, Industrial Education, Vocational 
Agriculture, and Homemaking. 

Vocational teachers generally have 
little or no background in their pro- 
fessional development that would aid 
them in^ better serving special needs 
students Tables 5 and, 6 show the 
amount of formal traifimg acquired 
by vocational teach6rs that may be 
beneficial to their working with stu- 
dents with special needs. 

It is obvious from the foregoing 
data that vocational teachers have, 
for tKe most part, little formal prepa- 
ration for working with special needs 
students Most have been exposed 
to the problems associated with 
teaching in the integrated setting 
only yirough the enrollment of spe- 
cial students in their classes. Table 1 
shows the extent to which vocational 
teachers have experienced special 
needs students in their classes. 

All vocational instructors in tjie 
secondary schools have not assumfed 
the responsibility to serve special 
needs populations^. Many times dis- 
tricts, schools, or teachers establish 
formal student entrance criteria to 
vocational subjects thai tend to elimi 
inate participalHon by special groups 
of students Responses to the Iowa 



Survey indicate that 40 percent of 
the vocationaKteachers in this state 
have established such barriers to 
participation m their classes. There- 
fore, some question exists whether 
or not teachers are aware that the 
practice of recflJiring entrance cri- 
teria based on performance, cogni- 
tive, and personal characteristics of 
students may, in fact, be discnmina- 
toty. At the, very least, such practices 
run contrary to the intent of both spe- 
cial education legislation and voca- 
tional special needs legislation, under 
which schools have the responsibility 
to teach students with special needs 
"in the least restrictive setting. That 
IS to say that the first responsibility 
to those students is to place them in 
the "regular" classroom ^here fea- 
sible and appropriate, and to utilize 
special education and special needs 
funds to provide supplementary ser- 
vices so that their opportunity for 
succe^^n that integrated setting is 
greatl^increased. Consequently, 
some examination of entrance cri- 
teria appears to be in order. Addi- 
tionally, the administration and su- 
pervision of vocational programs 
may need to- be examined in relation 
to student opportunities. (See 'recom- 
mendation no 6 at end of article.) 

The question of whether or not a 
teacher takes steps to supplement 
and/or modify instructional proce- 
dures, curriculum, and the classroom 
environment to accommodate spe- 
cial students may well be one of 
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" TABLE 3 

Number* of Iowa Survey Respondents by Subject Matter 


Subject 


Number 


'% of Total 


Business Education^ 
Vocational Agriculture 
Honnemaking 
Industrial Education 
Other 


407 
113 
386 

339 
11 


32.5 
9.0 
30 7 
27 0 
.8 


• Subject matter could not be determined in 9 cases 




TABLE 4 

Number of Iowa Survey Respondents by Years of Teaching Experience 


Years 

Experience 


Number 


% of Total 


1- 4 

5- 9 
10-14 
over 14 © 


376 
314 
220 
351 


29.8 
24.9 
17.5 
27.8 


^ TABLES 

Iowa Survey Responses to the Item. "1 Currently \^o\6 a Degree 
or Teaching Certification in Special Education " 




Number 

0 2 


Percent 


Deg ree 

Teaching Certification 

Neither 

No Response 


77 
36 
1097 
55 


* 61 
. 2.8 
' 86 7 
4.4 


-* 

TABLES 

Iowa Survey Responses to the Question, What Formal Training Have 
You Completed In Teaching Special Needs Sjtudents?" 


• 


Number 


* Percent 


None, 

Inservice Courses or Workshops 
College Courses 
0th ptr 

No'TOsponse ^ / 


895 
183 
143 
13 
31 


70.8 
14.5 

11.3 
1.0 
24 
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TABLE 7 



Iowa Survey Responses to the Question, Wh^t Teaching Experience Have 
You Had with Special Needs Students?" 





Number 


Percent 


None 


285 


22.5 


Have taught special classes 


113 


8.9 


Only in my regular classes 


827 


65.4 


Other 


30 


2.4 


No Response 


10 


.8 



TABLE 8 

Iowa Survey Responses to the Question. "Which of the Following Most 
Accurately Describes Your Feelings Regarding the Best Way to Providj^ 
Services to Disadvantaged and Handicapped Students in Secondary 
Vocational Education?" 



All Teachers 

Attitude ^ Responding 

Every effort should be made to integrate them mto regular" classes 
They should be taught in separate cjasses especially designed for their 
disadvantagement or handicap 
I haven't any strong feelings either way 
Other 




23.8% 
13 6% 



attitude. Overcoming the apprehen- 
sions, fears, and misunderstandings 
of what is requirecj^to teach a more 
diverse student population may be 
the first and most critical step toward 
a solution to the problem. Evidence 
gathered through the Iowa Survey 
indicates that approximately one- 
third of the state's vocational teach- 
ers were not for the concept of inte- 
grating, or mainstreaming, special 
needs students. Table 8 shows a 
breakdown of teachers' attitudes on 
the subject of integrating 

The other" responses from Table ^ 
8 were almost always a vote for inte- ' 
grating with some qualification such 
as providing additional help to the 
teacher, providing special training 
for teachers, reducing student load, 
etc. It would appear, thea^ that up to 
about 70- percent of Iowa's vocational 
teachers would not necessarily be 
against mainstreaming special needs 
students. To comply with the ntan- 
d^tes of the law. and with the best 
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thinking in the field — thinking based 
on experimentation, research, and foh_ 
low-up — insen/ice programs must be 
provided to help alLyocational teach- 
ers understand how best to main- 
stream students using the support 
services they presently have avail- 
able to them. Additionally, vocational 
teachers must be given the opportu- 
nity and support to develop alterna- 
tive strategics for meeting the needs 
of that population of students. Such 
alternative strategies might include 
the development of separate or segre- 
gated classes for certair) students if 
that were deemed the pnost appro- 
priate nnethod for addressing their 
unique learning problems. 

SERVICES AVAILABLE TO SPECIAL 
NEEDS STUDENTS 

Vocational educators responding to 
the Iowa Survey indicated a relatively 
low degree of scrccess in meeting the 
needs of sp^ecial needs sfudents in 
their classes. 
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TABLE 9 

Iowa Survey Responses to. To What Degree Do You Feel You Are Meeting 
the Vocational Needs of Disadvantaged and Handicapped Students 
In Your Classes Now?" 



Degree Number Percent 



Very successfully - 95 7.5 

Succeeding with most, but not alt 755 59 7 

Faihng with most, but not all 231 . 18.3 

Not at all , 117 9.2 

No response 67 5^ 



According to the data in Jable 9, 
close to 30 percent of the vocational 
teachers responding felt they were 
not being successful with special 
needs students. That information, to- 
gether with the fact the 63 percent 
are only succeeding with most" spe- 
cial needs students, points up the 
need for a major inservice effort to 
better equip vocational teachers to 
reach all their students 

Most teachers (86.8%) reported 
that there is a special education pro- 
gram in their school Many special 
needs students are receiving special 
education services However, the co- 
ordination of vocational and special 
education programs is left largely to 
chance. 

The terms special needs" and 
special education ' are viewed as 
synonomous by practitioners in the 
field. Consequently, teachers Ignore 
the plight of special needs students 
on the rationale that special educa- 
tion will take care of the problem. 
Typically, sp^ecial educators do not 
solicit the Input of vocational edu- 
cators while developing the Individ- 
ualized Educational Plan (lEP). Thus, 
vocational personnel are not helped 
to better understand the special needs 
of students, nor are they involved in 
helping solve their problems. Addi- 
tionally, special needs students are 
defined as those students not suc- 
ceeding In a vocational program As 
a rule, vocational educators do not 
seek the assistance of special edu- 
cators to help solve learning prob- 
lems. In most instances special edu- 



cation services are not for all, and 
are not provided because students are 
not labeled as ''handicapped " 

To correct the malady of how to 
utilize special needs resources at 
least two things need to happen (1) all 
practicing educators need to be aware 
that special needs students are not 
necessarily special education stu- 
dents—they are students who for 
some reason or other are not suc- 
ceeding in vocational classes, such 
lack of success being related to a 
disadvantagement or handicap — and 
(2), vocational educators and special 
educators must collaborate in plan- 
ning for both special needs students 
and special education students so as 
to provide support services to those 
students so they can find success. 

A surprisingly large number of 
respondents to the Iowa Survey were 
not aware of the various kinds of 
work-experience programs that might 
be available to their special needs 
students. However, there is evidence 
from the data in Table 10 that many 
students do have access to some type 
of work-experience program Teach- 
ers should be made aware of the 
availability of those programs. 

A variety of support services are 
available to special needs students 
Table 1 1 outlines the support services 
respondents* indicated were avail- 
able in their schools. 

From the data in Tables 10 and 11, 
It is evident that many vocational in- 
structors are not fully aware of ser- 
vices that may be available to Special 
needs students That knowledge in 
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TABLE 10 

Iowa Survey Responses to What Programs Are Available to 
the Special Needs Students You Teach'?" 



Program 



a Work-Study (Spec.Ea ) 

b. Employer School Program (ESP) 

c. Summer Youth Employment 
d Any CETA Program 

e. GYOP 

f OEO, or Community Action 



Don't 

Yes (%). No (%) Know (%) * 



649 (56) 316 (27) 194 (17) 

331 (30) 392 (36) 379 (34) 

390 (35) 282 (26) 429 (39) 

224 (21) 332 (31) 526 (48) 

237 (22) 301 (27) 559 (51) 

182 (17) 318 (30) 554 (53) 



TABLE 11 

Iowa Survey Response to "Which of the Following Support Services 
Are Readily Available to Special Needs Students in Your Classes'^" " 



* Don't 

Service ^ Yes (%) No (%) Know (%) 

a- Tutors 441 (39) 48O (43) 203 (18) 

b. Remedial instruction "914 (76) 195 (16) 92 ( 8) 

c Teacher aide(s). 389 (34) 630 (55) 123 (11) 

d. Psychological lesling/counselmg 1059 (87) 55 ( 5) 101 (8) 

a. Occupational testing/counseling 841 (71) 117 (10) 233 (19) 

School year on-lhe-job training 521 (44) 409 (35) 244 (21) 

g. After graduation placement services 186 (16) 508 (45) 441 (40) 

h Informal job placement during school year 410 (35) 400 (34) 365 (31) 



itself points up the need for inservice 
activities that will help make teachers 
aware of services they can utilize to 
meet the needs of a diverse popula- 
tion of students Additionally, inser- 
vice activities should include referral 
methods and techniques teachers can 
Incorporate as a part of their routine 
activities for helping students take 
advantage of supplementary services 

CLASS ENROLLMENT DATA 

Teachers were asked to give the en- 
rollment figures for each of their vo- 
cational classes as of September 15, 
1976. That date was used 'since it 
corresponds with 'the date schools 
use for reporting enrollments for the 
state aid formula, thus making the 
data readily available. Drops were 
to have been reported as oi the date 
of completing the survey instrument, 
which may have interfered with re- 
ceiving the best possible data in re- 
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gard to drops. The data reported by 
teachers may reflect dropouts from 
courses during the second semester 
only. This is suspected since the sur- 
vey was completed during the second 
semester, and the directions given in 
the survey instrument were mislead- 
ing as to how to report the informa- 
tion. Therefore, this part of the data 
has some definite limitations. Con- 
clusions stated concerning the drop- 
out data are subject to cautious inter- 
pretation First-semester-only courses 
were most likely not reported in any 
of the survey data obtained. 

An additional problem with the use 
of the data regarding studentS'Who 
have been dropped from the voca- 
tional classes lies in the lack of any 
reason given for dropping those stu- 
dents .Gross figures dealing with 
the number of students dropped re- 
.veal nothing about whether or not 
that student actually dropped from 
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TABLE 12 

Secondary Vocational Enrollments Reported on the Iowa Survey 



Grade 



Male 



Female 



Total 



9 


13.143 


13.061 


26.204 


10 


10.221 


10.857 


21.078 


11 


12.360 


14.517 


26.877 


12 


13.713 


15.744 


29.457 


TOTALS 


49.437 


54.179 


103.616 



school, just dropped out of the voca- 
tional class, transferred to another 
class, or anything useful as \p the 
disposition of the case. Hopefully, 
teachers responding to the survey 
interpreted the instruction to record 
drops in the conventional sense of 
drops from school." or "from this 
class. If that were the case, one 
could assume with some confidence 
(from the data) that fairly large num- 
bers of students seem to be leavmg 
vocational classes before successful 
completion of those classes That 
being the case, each of those stu- 
dents reported m the dropped" col- 
umn IS potentially a special needs stu- 
dent. 

Assammg that the Iowa Survey rep- 
resents about 65 percent of the total 
population, there are approximately 
160.000 student enrollments in sec- 
ondary vocational classes. It should 
be pointed out that these data do 
not imply 160.000 different students. 
Teachers reported total numbers of 
students enrolled in each of their 
vocational classes Undoubtedly, then, 
some students would be reported two 
or more times by a teacher who had 
that student m two or more different 
classes, or by more than one teacher 
responding to the survey from the 
same school. No data are available 
to determine the numbers of students 
counted more than once. 

Table 13 shows numbers of stu- 
dents who were reported as having 
been dropped from vocational classes 
and the percent those figures repre- 
sent of the data in Table 12. 

The data in Table 13 have several 



limitations. No definition of a "drop" 
was given the survey respondents 
Therefore, it is possible that these 
data include students who transferred 
from one class to another within a 
school Also, they could include stu- 
dents who transferred to other schools 
or districts. The students reported 
in Table 13 are not necessanly "drop- 
outs" in the conventional sense 

Even with those limitations in mind, 
there is cause for concern about the 
numbers of students who are reported 
as having been dropped from voca- 
tional classes. Historically, students 
drop out of school in larger propoc- 
tions at the tenth and eleventh grades 
Data collected in previous years indi- 
cates that composite dropout rates 
in Iowa's schools range from just 
over 2 percent in ninth grade to just 
under 6 percent in elev'fenth grade 
The information in Table 13 indicates 
that students are leaving vocational 
education in larger proportionis than 
they typically drop out of school Of 
special concern are the rates at the 
ninth and twelfth grades, which are 
more than double the expected drop- 
out rates. Considering the limitations 
of these c}ata. perhaps the best that 
can be said is that the evidence exists 
to support a more thorough investi- 
gation of the student attrition rates 
in vocational education across the 
state. The other extreme — assuming 
that the data are reliable— is that 
there is a serious problem in relation 
to student retention in vocational 
education. 

Considering the limitations on this 
class enrollment data described ear- 
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TABL€13 

Secondary Vocational Sfttdents Reported as Having Been Dropped 
from Vocational Classes on the Iowa Survey 



Grade 


Mate 


% 


Femate 


% 


Total 


% 


9 


763 


5 8 


632 


48 


1.395 


' 5.3 


10 


894 


8 7 


831 


77 


1.725 


8.2 


11 


960 


7 7 


1.283 


88 


2.243 


83 


12 


1.415 


10 3 


1,595 


10 1 


3,010 


10.2 


TOTALS 


4,032 


82 


4.341 


80 


8,373 


8 1 



TABLE 14 

Special Needs Students in Vocational Classes as Reported 
by Iowa Survey Respondents 



Male Female 

Row 





H* 


D- 


Total 


H' 


D" 


Total 


Total 


9 , 


420 


630 


1.050 


275 


479 


754 


1,803 


10 


269 


514 


783 


217 


434 


651 


1,434 


11 


228 


490 


718 


168 


463 


631 


1.349 


12' 


242 


434 


676 


175 


381 


556 


1,232 


TOTALS 


1.159 


2,068 


3,227 


835 


1.757 


2.592 


5,819 



(Est 100% 8,952) 



* H = Handicapped 
*• D = Disadvantaged 



lier, the nearly 9.000 special needs 
students reported in Table 14 is only 
^a gross estimate (The 9.000 figure 
^is based on the assumption that the 
5,819 students actually reported rep- 
resent only 65 percent of the total 
population.) The evidence does sug- 
gest, however, that vocational teach- 
ers do recognize that special needs 
students are, m fact, enrolled in 
their classes. 

IDENTIFICATION OF INSTRUCTIONAL 
PROBLEM AREAS 

Teachers were asked to indicate, from 
a list of 58 potential problems, the 
areas whic^x prevented them from 
being succ^essful with special needs 
students in their classes Table 15 il- 
lustrates the student-related problem 
areas^as perceived by the t^achers. 

er|c ' 



Over 70 percent of the respondents 
indicated that low reading and math 
ability were the two problems they 
have in attempting to serve these stu- 
dents. The "apathy toward school" 
problem of disadvantaged students 
was mentioned by 67 percent of the 
respondents, while 59 percent cited 
poor job-task skills by handicapped 
students as a problem Otherwise, the 
problems in Table 15 were all within 
the 40-55 percent range. Note that 
teachers did not attribute any prob- 
lems specifically to handicapped stu- 
dents. Seven of the 10 problems were 
attributed solely to disadvantaged 
students. Conventional wisdom dic- 
tates that there is probably a relation- 
ship between some, if not all, of those 
seven problems and the two problems 
mentioned by the greater number of 
respondents — low reading and math 
ability. 
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TABLE 15 

. Student-Related Problems in Serving Special Needs Students as Reported 
by 40% or More of the Respondents to the Iowa Survey 



1 Poor Attendance D 

2 Poor Interpersonal Skills B 

3 Cannot/does not accept responsibility D 

4 Poor)ob-task (performance) skills B 

5 Motivational Problems D 

6 Are apathetic toward school in general D 

7 Low reading ability B 
8. Low math ability _ B 
9 Educational problems are pnmarily a result of home environment D 

10 Career goals are not well established D 



H - Characteristic of Handicapped Students 

D ^ Characteristic of Disadvantaged Students 

B Characteristic of Both Handicapped and Disadvantaged Students 



TABL£ 16 

Teacher Related Problenns in Serving Special Needs Students as Reported 
by 40% or More of Iowa Survey Respondents 



1. No training in identifying special needs students B 

2 Not adequately trained to deal with them, once identified B 

3 Do not have extra paid time to develop activities for them ^ B 

4 Do not have released time B 

5 No mservice available B 

6 Student load too great B 



B ^ Both Handicapped and Disadvantaged 



Table 1 6 shows the problems unique 
to the teacher in dealing with special 
needs students. 

Teacher concerns seem to focus 
on the need for more adequate train- 
ing and more acceptable working 
conditLons to serve students rhore 
effectively. The next section attempts 
to delineate sonne potential solutions 
to the problems identified m Tables 
15 and 16. 

IDENTIFICATION OF SOLUTIONS 

Teachers were asked to rank poten- 
tial solutions to the problems they 
encounter in working with special 
needs students in the Integrated set- 
ting. Table 17 shows the rankings 
they gave to five different solutions. 

Clearly, teachers see t^ie 'need for 
appropriate mservice training if they 
are to better serve special needs stu- 
dents in their classes If mservice is 



to be provided, they would place the 
highest priority on activities that would 
help them diagnose individual stu- 
dent needs. Next, they would choose 
activities to help them do a better 
job individualizing instruction to ac- 
commodate the diverse needs of stu- 
dents. Table 18 illustrates th'e< prior- 
ity rankings given inservice activities 

The rankings given in Table 18 are 
not surprising when placed m the 
context of the learning continuum 
(i e , diagnosiS'prescription-evalua- 
tion). It would appear that teachers 
feel the need to determine student 
problems before they can set about 
to remediate them. 

The data in Tables 19 and 20 deal 
with the provision of resources to 
help teachers and districts finance 
various modifications to existing pro- 
grams to better serve special needs 
students. 
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TABLE 17 



Rankings Given Five Potential Solutions to Problems in Working 
"With Special Needs Students by Iowa Survey Respondents 





- 


No Times 


Mean 


Median 


Rank 


Item 


Ranked T' 


Ranking 


Ranking 


1 


Additional inservice training 


433 


2 506 


2 218 


2 


Additional manpower (aides, tutors/ 










teachers, counselors, etc ) 


331 


2 73> 


2 687 


3 


Additional planning time 


177 


2 902 


2 783 


4 


Additional equipment, supplies, space 


184 


3312 


3 497 


5 


Consultative services 


69 


3 485 






TABLE 18 










Rank-Order of Inservice Activities by Iowa Survey Respondents 








No Times 


• Mean 


iVIcU lail 


Rank 


Item 


Ranked "1" 


Ranking 


rial irNii lu 


'l \ 


Activities involving dia^i|OSing individual 










student needs ^ 


509 


2 051 


1 753 


2 


Activities involving individualizing 










instructipn 


345 


2415 


2 190 


3 


Activities involving student evaluation 


91 ' 


3 102 


3 105 


4 


Activities involving the use^f special 










' equipnnenl, supplies, and space needs for 










^ special needs students- 


191 


3 254 


3 498 


c 
0 


Activities involving job placement 


59 


4 078 


4 504 




TABLE 19 










Ranking of In-Class Services that Would Help Teachers 






fetter Serve Special Needs Students 










No Times 


Mean 


Median 


Rank 


Item f 


Ranked "1 " 


Ranking 


Ranking 


•| 


Teacher aide(s) 


470 


1 790 


1 /ob 


2 


Teacher(s) 


452 


2 050 


2.113 


o 
O 


Tulor(s) 


245 


2 183 


2 223 




TABLE 20 










Ranking of Out-of-Class Services that Would Help Teachers 






Better Serve Special Needs Students 










No Times 


Mean 


Median 


Rank 


Item 


Ranl^ed "1" 


Ranking 


Ranking 


1 


Special teachers-remedial 


TE \ — 

405 


2 216 


2.010 


2 


Special teachers-vocational 


363 


2 373 


2 146 


3 


Job development, placement, work- 










experience 


217 


3 232 


3 463 


4 


-Tulor(s) 


133 


3 405. 


3 475 


5 


Additional counseling services * . 


68 


3 670 


3.855 



TABLE 21 

Rankings Given Sources of Consultative Help for Information and Strategies 
for Serving Special Needs Students 



No. Times Mean Median 
• Rank Hem Ranked "1" Ranking Ranking 



1 


Skilled staff persons within my school 










district 


430 


2 267 


1.835 


2 


No preference, as long as the person was 










qualified 


460 


2.852 


2.043 


3 


Area Education Agency 


158 


2.932 


2 767 


4 


College or University , 


51 


4.160 


4.368 ^ 


5 


State Dept of Public Instruction 


37 


4.211 


4 374 


6 


Another School Distnct(s) 


22 


4.300 


- 4.409 



Teachers were in favor of utilizing 
skilled staff persons within their own 
school district to help In the develop- 
ment of activities to serve special 
nee^s students. Any qualified person 
ranked second among the choices 
Table 21 shows the rankings given 
the SIX sources of consultative help. 

The rankings in Table 21 definitely 
validate acceptance of a local staff 
person as a primary resource for in- 
service. Clearly, local staff should be 
considered when choosing trainers 
for other teachers. 

SUMMARY 

The Iowa Vocational Education/Spe- 
cial Needs Assessment project was 
an attempt to obtain data directly 
from vocational teachers concerning 
their classroom experiences with 
special needs students Through the 
first mailing of survey instruments a 
*"65 percent ret^fn was obtained. Re- 
sponses came from a wide represen- 
tation of vocational teachers in the 
" state. Adequate numbers of begm- 
* ' ning and experienced teachers^ those 
teaching in various sized schools, 
and teachers In all levels and areas 
of subject matter responded to the 
survey. Teachers representing over 
100,000 students supplied informa- 
tion about their classroom dropout 
rates and numbers of students they 
perceived as being disadvantaged and 
handicapped They reported an 8 per- 
cent dropout rate, overall, and Indi- 
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cated that 9 percent of the total voca- 
tional enrollment were special needs 
students. 

Respondents were frank in admit- 
ting their lack of success in serving 
special needs students Thirty per- 
cent said they were either failing with 
most special needs students or were 
failing with all of them Thirty percent 
also indicated that they thought spe- 
cial needs students should not be 
integrated into regular classes Thi'rty- 
two percent said they should be inte- 
grated, and the balance did not have 
a definite opinion on the subject. 

Surprisingly large numbers of vo- 
cational teachers were not aware of 
the various career exploxatlon and 
work-experience programs that 
might be available to special needs 
students m their schools, districts, 
Of community A relatively high level 
of academic and counseling support 
services was Indicated. 

Teachers pointed to a number of 
problem areas they encounter when 
serving disadvantaged and handi- 
capped , students. Those mentioned 
most frequently were low reading and 
math ability of both populations. 
Other problems-^attributed to both 
handicapped and disadvantaged stu- 
dents included poor Interpersonal 
skills and poor work skills, In addi- * 
tion. disadvarntaged students were 
characterized as having poor atten- 
dance, not b^lng able to accept re- 
sponslbility. not being motivated, 



being apathetic toward school, not 
having career goals, and having edu- 
cational problenns as*a result of poor 
home environments 

In looking at their own situation, 
teachers identified the need for more 
training to recognize and deal with 
special needs students They indi- 
cated a need for more mservice and 
time to get involved in it - They also 
mentioned the problem of too large 
a student load to adequately deal with 
the individual needs of special stu- 
dents 

As for solutions to the problem,'' 
teach^ers identified mservice train- 
ing as the number one need Aides, 
tutors, and additional manpower was 
their second choice of potential solu- 
tions Additional planning time was 
ranked third Choosing from a list^ 
of possible mservice activities, teach- 
ers picked Jhose involving diagnos- 
ing individual student needs as their 
first choice, followed by activities 
for individualizing instruction and 
activities involving evaluation Con- 
cerning the type, of mservice they 
>^ould choose, teachers selected how- 
tp-do It exercises In rating the use 
df additional manpower as solution 
40 the problem, teachers indicated a 
need for teacher aides, followed by 
ad(Jitional teachers For out-of-class 
manpower services, they were in .fa- 
vor of special remedial teachers an^ 
special vocational teachers 

RECOMMENDATIONS 

1 A.follovv-up survey should be con- 
ducted at the secondary level This 
survey should be designed to answer 
some of^the questions raised by the 
presen^^urvey data For instance, 
the present ^ata would mdicgte that 
there is a problem with students 
dropping out of vocational classed 
A closer analysis of that possibility 
IS in order Additionally, it should be 
determined whether or not those drop- 
outs invoWe special needs students 
in larger numbers than are found irt 
the general population. 
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The present data would alsjD indi- 
cate that the special needs popula- 
tion represents about 9 percent of 
the total vocational population A 
carefully designed follow-up survey 
could determine the exact ratio and 
total population, thus providing a 
better input of data for more equitable 
distribution of resources. Another 
purpose that a follow-up suVvey 
would serve is to obtain more defin- 
itive data on the broad range of ser- 
vicers, bpth schdol , sponsored and 
community sponsor-ed, available to 
special needs students 

It IS recommended that the follow- 
up si^rvey involve a randprn'^sample 
of no more t-hanJO sclnools in the 
state reprlesenting several strata pf 
programming Thase strata should 
include district size (five categories), 
number of state-reimbursed pro- 
grams (three strata), number of spe- 
cial peeds students ti^y percent of 
population (two or three strata), and 
district per capita wealth (two or 
three strata) Other strata may'be 
necessary. An m-depth irjvestigation 
of each subject school involving th^ 
Collection of data on identified staff 
persons, classes,' special needs stu- 
dents, supplementary programs, and 
fiscal resources should then be con- 
ducted The case study approach may 
be appropriate in such a study. 

2 A dissemination systen? needs tq 
be developed that will con^antly 
make administrators, teachers, CQun- " 
selors and other edu<:ational person- 
nel aware of the rules and regulation^ 
regarding the provision of services 
to special needs students Such in- 
formation should include clarifica- 
tion of definitions^ and categories, 
types of services required and avail- 
able, arid methods of delivering ap- 
propriate services. « 

3 Inservice activities should be pro- 
vided to persons interested in^jn- 
creasing the level of services being 
provided^to vocational special needs 
students They should include aware- 
ness activities for all levels of educa- 
tional personpel, including college 
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and univeriity, DPI, Area Community^' 
CoHege, Area Education AgeTicy. and 
locaFs^ool district ^Triservice activi- 
ties for teachers should include how- 
to-do-it exercises for identifying and 
assessmg special n^eds students, de- 
veloping indivi'dualized irrstruction, ^ 
monitoring and evaluating student 
progress, and conducting follow-up. 

In developing inservice programs 
for local districts the interdisciplinary 
approach should be stressed. That 
approach includes the development 
of Individual Vocatic^naLPIans (IVP's) 
utilizing input from administration, 
counselors, special education and 
vocational education personnel. Ad- 
ditionally, mservice should be devel- 
oped involving the best use of tram- 
, Qrs fronn higher educatiofi, DPI, Area 
Community Colleges, and theA.E A.'s. 
4 Inservice for local teachers, coun- 
selors' aifd administrators should 
include p^sentations by and obser- 
vation Of injnovative .vocational spe- 
cial needs programs over the state. 
"5 Inservice a>>t4vities should also 
emphasize th^* use of innovative cur- 
riculum nrtaterials, designed espe- 
cially for this pdpulation. There is 
currently a wid^ selection of mate- 
rials available fo aid teachers in the 
identific;jitionrassessment, instruc- 
tional, and evaluation process^ Most 
are easily adopted to the diifenag 
local situations Instruction in'the, 
use of these materials (how-to-do-it) 
IS an essential ingredient in any voca- 
tional special needs inservice effort. 

6 Entrance criteria for participation in 
many vocational preparatory^jourses 
at the secondary level should be in- 
vestigated. It has been a long-stand- 
ing policy of many schools to estab- 
lish fairly stringent selective criteria 
for students v^^fio wish to particjpate 
in cooperative work-experience pro- 
grams (pistributive Education, Trades 
and Industries Coop. Office Co6p, 
etc ) That practice may not be allow- 
able under recent laws Steps need 
to be taken to insure that all students 
have equal access to such programs. 

7 A final recommendation, not spe- 



Xifically related to special needs, deals 
with 'the accessibility of data on edu- 
cational personnel in the field In the 
case pf this survey, the best^ list of, 
vocatigjial teachers obtainable in- 
cluded nearly 2,000 names of persons 
not actively teaching vocational sub- 
jects For research purposes and tor 
a variety of other reasons a data col- 
lection fystem should be devised that 
would better delineate only those 
persons attgally involved m specific 
educational activities in local and 
area edacatior>al agencies 
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Assessment gf the Prevalence and Service Need 
Requirements of Handicapped and Disadvantaged 
Students in Vocational-Technical Education ^ 
Programs in Minnesota . 



GERALD aSCHNECK 
^- University Qf-Wiscorisin^Stout 
LOWELL P. LERWICK and 
GEORGE y. COPA 
University of Minnesota 
In action by the ^977 session of the 
Minnesota Legislature, the 1977 Omni- 
bus, School Aids Bilj (House Fil^ 550 
or Chapter 447. Article '4. Section 18) 
contained the following charge 
The Stdte Board of Education shall con- 
duct a state-wide needs assessment fbr 
the purpose of determining future pro^ 
gram needs for services, to handicapped 
or disadvantaged students m vocatio/iaL- 
technical educatiorv. Information for this 
needs assessment shall include data cof^ 
(acted by the Division of Special and Com- 
^ PQnsatory Ed'ucat'ion and the Division of 
Vocational-Technical Education concern- 

* mg the vocational training needs of handi- 
capped and disadvantaged students- The 
result of Ihis assessment shall be reported 
to the State Legislature by February, 1978; 
The, sum of Jl 5.000 is ap^propriated from 
the General Fund to the* Department of 
Education for the purposes of th»6 sec- 
tion, to be made available until March 1, 
1978. . ' ' ^ , 

This tegislative char^ was deter- 
mjned by the Minnesota St^^ De- 
partment 'of Education .to be -a }Oint 
responsibihty of both its Division of 
Special and Compensatory Edi^catron 
and Division of Vocational-Teohnical 
Edtjcation. Th'ese agencies were 
viewed as. the major sd^irces of ijrfbr- 
mation about*r>haodicapped and dis^ 
-advantage^ p.^rsons jn vocational- 
technical education in'^Minnesota and 

* al^o in the best position to nnake 
recomnrrer^ations about the means 



and resources requirements to im- 
prove services to these persons Tbe 
study described m this article was 
commissioned to provide informa- 
tional input to the recommendation 
development process used by the 
above-mentior^ed agencies. ^ 

PURPOSE ^ 

This study focuses on providing the' 
best possible descnptioji of the pres- 
ent (as opposed to past or future) 

^rieed 1or services by harJ&icapped or 
dijadvantaged persons who want and 
coulfJ benefit from vocational-techni- 
cal education In ^Min'nesota. The 
words^'best possible" mean what is 
poss//?/e" given 'existing d'ata and the 
time and financial resources available 
fo conduct the study: The words 
"want and could benefit" mean the 
study IS nof limited to only those 
f)fe$ently enrdllecJ in vocational- 

. technical education programs, but 
also includes those additior>al per- 
sons wt)o might enroll if <hey were 
, provided the needed special servipes 
Since it is foCused'on the presenf/the 
data reported are l^argely cross-sec- 
tional rather than longitudinal which 

^would provide a tren(^ over time. The 
decision to foous on the present was 
made at the timfe the s^udy pr*op.o'saI 

-was developed and reviewed, focus 

, on the present was rationalizecf at 
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this time by questions concerning the 
availability of both historic or future 
data and the high priority -given to 
obtaining a good description of 
' what \s" as a base pomt for future 
planning 

Sfc>ecifically. the study objectives 
were ♦ 

1 To operationally define and speci.fy 
the critena 'by which to identify per- 
sons who are ^handicapped and di|- 
advantagecfk 

2 To esliroale the prevalence of per- 
sons whc^re handicapped and/or 
disadvantaged, in terms of number 
and percentage of the total popula- 
tion V • ' • 

3 To list and describe the present 
services being provided to rpeel the 
needs of handicapped and disadvan- 

. taged Slyctents in vocationahtechni- 
cal education) t 

4 Jo identify the sources and relative 
allocations of present Slate and 
Federal fu'^nds for services to handi- 
capped and disadvar>laged students 
in vocational-techniCaftducation 

STAFF AND RESO'UBCES 

The study was conducled^during the 
Ihr^-monthpenodof0ctober1 3.1977 
to January 16, 1978 In addition to the 
director, the project employed*a staff 
of one Research Fellow, one Project 
Assistanfand one secretary 

A Steering Committee was used to 
provide guidance in carrying out the 
objectives of the study in an efficient 
manner The 11-member committee 
was composed of representatives of 
the following organisations 
.Minnesota Slate Department of 
EduccitiOFi 

Division of Special and 

Compensatory Education 

Division ofA/ocational-Technical 

''Education 
Local Educational Agencies (two) 

Consumer Organizations 

Minnesota. Association of Children 

v|/ifh Learning Disabilities 
Minnesota Research and Development 

■ ' ioO ^ 



Center for Vocational Education 
(University of Minnesota) 

The Committee met five times dur-. 
ing the three-month duration of the 
study 

PROCEDURES 

Due to the time and financial con- 
straints, as welf as concern f6r aVoid- 
ante of duplicated data collection/ 
the study was conducted using sec- 
ondary (i e., existing) sources of data 
rather than co*ncenfrating on actual 
collection of primary or new. first- 
hand information Investigation of 
secondary datst sources was con- 
ducted through' interview with indi- 
viduals knowledgeable about the col- 
lection and analyses of relevant 
existing dat'g^j^.Dala available at each 
secondary source wa6 used either 
direc|ly or after additional manipula- 
tion as needed to- meet the purposes 
of the stucjy The compatibility of 
information collected from various 
sources was investigated in order »to 
portray the eoctenl and limitations of 
existing dat^ collectio^i' and sinalysis 
procedures, in addition, the informa- ^ 
tion collected yy^^ll facilitate" improve- 
ment «of the data sources. The most 
current information available from 
each source was used 

The study was conducted as a series 
of activities which>. necessarily over- 
lapped in time and focus. The activi- 
ties were as follows., 

1 Identify definitions of handi- 
capped ' and disadvantaged" and 
"special services ' used by Federal 
and Minnesota agencies 

2 Select indicators of handicapppd" 
• and "disadvantaged" conditions for 

which data were available in Minne- 
sota. ^' 

3. Identify an^ investigate secondary 
data sources to describe the preva- 
lence of, services taand funding for 
handicappecf and disadvantaged per- 
sons who. want and could benefit 
from vocational-technical' educatiom 
Sources investigated include 
• U.S Department of Qommerce. 
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Bureau of the Census. 1970 Census 
of Population 

• US Office of Education. Bureau of 
Education for the Handicapped 

• 'US National Center^for Educational 
' Statistics 

• Minnesota Department of Education 
Division of Special ^nd Compensa- 
tory Education . ' 

Division of Vocational Technical 
Education 
--Special Meeds Vocational 

Programs 
— Prograrri PJannmg and Qe- 
velopment Section 
State Aids. Statistics and Research 
Section 

Division ^ot Planning and Develop- 
ment 

, Professiorial Staff Library 

• Minnesota Department of Economic 
Security * 
Division of Vocational Rehabilitation 
Division of Employnnent Services 
Mmne$ota Governors Manpowe 

Office 

• Minnesota State Planning Agenoy 
'Office of the State Demographer 
Developmental Drsabilities Section 

• Minnesota Department of Public 
Health 

• "Minnesota- D.epartment oi Public 
' Welfgre 

• Minnesota Association* of Retarded 
Citizens 

• Minnesota Governor s Council for 
the Handicapped 

• Minnesota Department of Correc- 
tions # 

*• Minnesota Educational Computer 
Consortium (MECC) 

• University of Minnesota 
Department of Vocational and 

Technical Education n 
Special. Education Program. iDepart- 
menl of Psychoeducational 
Studies 

Minnesota Analysis and Planning 

System (MAPS) ^ 
Department of fhysipal and Reha'" 

bilitation Medicine 
Vocatioryal Psychology.. Research. 

Department of Psychology * 
Adult Basic Education Program 

(ABE) ^ i 



Rehabilitation Counseling Pro- 
gram, Department of Guidance and 
Counseling. St. Cloud State Uni- 
versity 

Total Information fducation System 
(TIES) (Minnesota) 
Rehabilitation Research. and Train- 
ing Center, University of Wisdonsm- 
Stout 

Hennepin County Court Services 
(Minnesota) 

Secondary Alienated Youth* Alterna- 
tive Education Programs Project, 
Clearingtiouse and Training Genter 
(Minnesota) 

CETA — Region III Evaluation 

Center (Minnesota) 

Northwest Regional Foundation 

(Minnesota) 

Multi-Resources Center, Inc. 
(Minnesota) 

N6rth Hennepin Planningr^ Projefcit 
(Minrre^ota) 




•-Special Needs Coordmato 
Lakes and Minneapolis Are 
tional-Technical Institutes 
(Minnesota) 
A more detailed listing of sources and 
specific persons contacted is provided 
in- Appendix I of the Fmal Report 
4| Develop estimates of the prevalence 
ccy handicapped and disadvantaged 
persons in Minnesota, particularly 
those who want and could benefit from 
' vdcationaljtechnical education; 
5 DQScnBe tthe" srervices presently 
available for handicapped and cfis* 
advantaged persops in vocational- 
technical education programs in 
Minnesota. 
^6 Qescribe the* funding sources and 
amounts expended for services to 
handicapped and disadvantaged per- 
sons in vocational-technical educa- 
tion programs in Minnesota.^ 

7 Determine the assumpticfns and 
linjiitations of secondary data used to 
describe prevalence of and services 
and funding for handicapped and dis- ■ 
^advantaged persons 

8 Writ^ and disseminate a full study 
report and executive summary A trme , 
schedule of activities ^is shown in 
Appendix II of the Final Report . 
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CONCLUSIONS 

Investigation of data and information 
surrounding each of the objectives of 
the study, resulted in a number of con- 
clusions specific to each. A detailed 
explanation of how these conclusions 
were reached is described in the Final 
Report of this study Conclusions for 
each study objective are as follows* 

1 To operationally^define and specify 
the criteria by which to identify per- 
sons who are, handicapped and dis- 
advantaged 

• The likely overlap between special 
education and special needs voca- 
tional education is for handicapped 
persons in grades nine^to twelve 

• Definitions and indicators are more 
specific and ^consistent 'across 
levels of government and agencies 
within levels for handicapped than 
for disadvantaged persons 

• Both handicapped and disadvan- 
taged persons can be identified in 
terms of causal and effect (func- 
tional) characteristics The use^f 
effect (functional) characteristrcs 
seems of most concern to voca- 
tional education 

• Using the effect or functional 
method to define handicapped or 
disadvantaged persons requires 
that the situation or enviropment 
within which the person is to func- 
tion be considered 

• Considerable variation in expertise, 
information and technology is 
needed to identify persons using 
various Indicators of handicapped 
and disadvantaged conditions 

• There are a large number of differ- 
ent types of services which are 
needed to remediate the effects of 
handicapped and disadvantaged 
persons 

• Persons may have more than one 
handicapping condition or may be 
both handicapped and dis-advan- 
taged 

• The validity or faifness of indicators 
of handicapped or disadvantaged 
conditions can change with age 
(e g . unemployment is not a useful 



indicator for those in school, lack of 
educational achievement'may 'not 
be a useful indicator for adults) 
2 To estimate the prevalence of per- 
sons who are handicapped and/or 
disadvantaged, in terms of number 
and percentage of the total popula- 
tion 

• Prevalency estimates available for 
Minnesota in term^ of proportion 
and number have marginal accu- 
racy and completeness at this time 
An exception is the prevalency esti- 
mates for the functionally disabled 
currently being developed from a 
study by the Minnesota Division of 

''Vocational Rehabilitation. 

• Both definition and method of as- 
sessment problems are hindering 

i the develbpment of better preva- 
lency estimates. 

• Using broad functional definition 
of the disabled, approximately 14 
percer^t of Minnesota's population 
IS disabled. 

• Considering the whole age range 
of the population, the rank order 
of prevalence for broad functional 
disability indicators is. physical 
disability (by far the highest). heaV- 
ing, blindness and vision. deveJop- 
mental disability (includes mentally 
retarded, cerebral palsied, epilepsy, 
dyslexia and autism), mental illness, 
speech, and chemical dependency. 

• Reading below success level is the 
most prevalent diSjadvantagement 
indicator for secondary and post- * 
secondary education-age groups. 

• Thera is .likely a higher prevalence 
rate of academically disadvantaged 
students in segondary vocational* 
education programs than in the total 
^secondary school population. «/ 

m There is likely a higher prevalence 
rate of academically and economi- 
cally disadvantaged students m 
post-secondary vocationaf educa- ^ 
tion programs than in other types 
of post-secondary education. 

• There are several reasons that are 
likfely to keep a person from enroll- 
ing in an additional job-related train- 
ing program for those 16 years of 

80 



'age and old^ who are interested 
in such training They are m order 
from highest to lowest, cost of pro- 
gram, work takes loo much tjme. 

Jack of information, family obliga- 
tion (these last three are essen- 
tially at the same prevalency rate), 
and transportation problems 

• There afe a number of self-per- 
ceived characteristics which might 
cause hesitation to attend addi- 
tional jbb-related training for per- 
sons 16 years of age and older who 
are interested in such training. The 
Pfevalency ranges from approxi- 
mately two to four percent in pre- 
liminary estimates for "reading diffi- 
culty, physically handicapped, hard 
of hearing, writing difficulty, and 
arithmetic skills 

3 To list and describe the present ser- 
vices being provided to'meet the 
needs of handicapped and disad- 
vantaged students in vocational- 
technical education 

• Many agencies, groups and indi- 
viduals are involved in providing 
services Documentation of services 
provided* across and within service 
sources, and subsequent detailed 
analysis for disclosure of extent, 
duplication and gaps was not totally 
possible with the data that was 
identified. 

• Organizational .units have been de- 
veloped within the Department of 
Education to serve handicapped 
and disadvantaged persons in vo- 
cational education. These units 
have attempted a self-assessment 
to idenjtify how they fit together 

• Economically disadvantaged per- 
sons needing vocational education 
can receive a wealth of services 
through CETA programs ^ 

• An unidentifiable group of second- 
ary vocational education students 
who are handicapped and disad- 
vantaged are t>eing serveck-lhrough 
regular vocational education pro- 
grams via the concept of main- 
streaming' without support ser- 
vices The identifiable portion of 
special needs vocational education 
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persons at the secondary level are 
in segregated classes. When com- 
paring education levels, these sec- 
ondary students are the largest 
group served through Special 
Needs Vocational Programs. 
' • Approximately one-third of post- 
secondary vocational education 
students are handicapped or dis- 
advantaged with the ratign being 
approximately one to three, respec- 
tively. Handicapped students are 
using about twice as many annual 
hours of service time per person as 
disadvantaged persons There is 
considerable variance in time used 
^between different handicaps and 
'disadvantages and between differ- 
ent types of services to. these two 
groups. 

• Special needs vocational education 
for adults is very limited in scope 
and number served 

• The Special Needs Assessment 
Project (SNAP) has the potential 
to provide the beginnings of a ryian- 
agement information system (MIS) 
for special needs vocational edu- 
cation service at th,e post-secondary 
level Its effectiveness is limited by 
lack of mandatory data submission 
by each AVTI and adequate means 
to process and monitor'^data anal- 
ysis and report generation Once 
It IS effectively interfaced with the 
operations of the Minnesota Ppst- 
Secondary Follow-Up System, it 
will be possible to determine out- 
comes in terms of job placement 
and activity on nearly all program 
leavers (completers and drop-outs) 

• Handicapping conditions tended 
to sigfiify more definite and spe- 
cific vocational program an(^ spe- 
cial service needs than disadvan- 
taged conditions. 

• More severe handicapping condi- 
tions tended to need more differ- 
ent types of special servrces. 

• Nearly all categories of vocational 
programs and services used in the 
survey were identified as potential 
needs for all of the handicapping 
conditions listed. 
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• A significant number of direct and 
non-direct educational support 

, services, which fait outlfeide of pres- 
1 ent special needs vocational edu- 
cation service categories. ^ere 
' identified as necessary to the suc- 
cess of handidapped students in 
vocational education programs 

• Disadvantaging conditions tended 
to indicate a wide range' of poten- 
tial vocational program and ser- 
vice needs. In general, fewer pro- 
grams and services were judged as 
probably being needed when cor|n- 
pared to results for the handi- 
capped 

• Indicators of the disadvantaged 
au^peared to provide limited utility 
in determination of special voca- 

~ tional needs of disadvantaged per- 
sons. 

• Indicators used to identify disad- 
vantaging conditions did not reveal 
other direct or non-direct education 
support services that would fur- 
ther enhance success m vocational 

'training programs 

• Special education support services 
in regular vocational education 
programs tended to be neede^l more 
than special instruction programs 
in meeting the vocatjonal needs of 
disadvantaged persons. 

• A more extensive investigation of 
the vocational program and sup- 
port service needs of handicapped 
and, disadvantaged persons' is nec- 
essary to determine both prfesent 
and future needs. Consideration 
as to the scope and extent of ser- 
vices would be necessary to more 
adequately represent all param- 
eters of service need requirements 
for^decision-making. 

4 Jo identify the sources and relative 
allocations of present State and Fed- 
eraf funds for services to handicapped 
] and disadvantaged students in voca- 
tional-technical education * 

• Tracing of the flow of lunds be- 
tween and within some agencies 

^ IS not possible given constraints 
of the vaneties of definitions; pro- 
gram delivery, and methods pf data 



collection .and analysis adhered to 
by the many human service agen- 
cies involved j 

• The Division of Special and Com- 
pensatory Education will serve 
nearly 90.000 (duplicated count) 
handicapped persons age 4 to 21, 
or until completion of a secondary 
program, dunng FY 78 

''^^^^he total agency budget amounts 
to approximately $110,000,000 
for FY 78 

— Programs and services are fi- 
nanced wUhin public schools. 
State operated hpspitals and 
special schools, correctional 
facilities and for high-priority 
or low-incidence groups of 
handicapped. 

— In-service training of *adminis-*^ 
trative and classroom instructors « 
IS also a significant portion of 
their operations. 

— Funding sources for FY 78 ap- 
pears to be 7 percent Federal, 
*61, percent Stale- and 32 percent 

local. / 

— Allocations to the Division of 
Vocational-Technical Education 
are made to aid in the cost of 
personnel salaries of secondary 
level special needs positions 
which are used to support voca- 
tional aspects of the Special 
Eflucation program Reimburse- 
ment IS made for fully certified 

* personnel only 

• The Division of Vocational Rehabil' . 
itatiOn estimates serving 37.000 
handicapped clients Of employable 
age during TY 77 Of this number, 
about 17.000"needed«outlay of funds 
for services or in direct support of 
individuals. 

— Total agency funding is from 80 , 
percent Federal and 20 percent 
State sources 

— The total agency budget amounts 
' tQ about $14,000,000 far FY 77, 

of which $8,200,000 is in direct 
support of individual clients 

— Training is a vital rem*ediation 
technique utilized by the agency 
to the extent of using 66 percent 
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of direct client services funds 
(37 percent of the total agency 
budget) 

— During FY 77, 9,214 clients or 
^25 percent of total served by the 
*agency were involved in train- 
ing activities 

— During FY 77 2.182 clients were 
involved in vocational education 
programs with supportive ser* 
vices afid funds from the Divi- 
sion of Vocational Rehabilita- 
tion This ac^unts for 6 percent 
of the total ^rvice population' 
of the agency 

— The 2.182 clients receiving voca- 
tional education supportive ser- 
vices and funds during FY 77 
u^ed S709.388 or 5 percent of 
the total agency budget" f his 
^mounts to 13 percent of the 
training (unds used 

• Comprehensfve Employment and' 
Training Act (CETA) Youth Employ- 
ment and Demonstration Profects 
Act (YEDPA) 

~ CETA estimatefj serving '70.409 
persons during FY 77, of*which 
35.909 (51 pjBrcent) were unem-* 
ployed youths 

— Total CETA funding was from 
Federal sources and amounted 
to approximately $226,600,000 
m FY 77. 

— The CETA pro^gram is aimed at 
unemployed/underemployed per- 
sons 

— CETA funding is permissive, 
within Title guidelirves. to the 
degree of deternnining how pro- 
grams and services are imple- 
mented, being placed with each 
of 10 prime sponsors in the 
State of Minnesota 

— CETA authorizes public ser,vice 
employment, development of 
new employment positions, vo- 
cational training, planning, and 
other activities , ^ 

— YEDPA program is a* newly* . 
I funded prograrh (FY 7fe) for serv< 

ing unemp^lqyed and underem- 
ployed yQuth A minimum ol 
$8,400,000 IS to be allocated to 
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the State for this program during 
the year No estimates of total 
participation were available 

/-YEDPA authorizes creation of 
employment positions, voca- 
tional training, program plan- 
ning, and other efforts directed 
• toward promotion of vocational 
skill training 'and employment 
of these youths 

Division of Vocajional'Technical 

Education 

— Total agency budget for FY 77 
was about $176,500,000 from 6 
percent Federal. 55 percent State. 
30 percent local, and 9 percent 
other sources 

— It IS estimated that 26,000- handi- 
capped and disadvantaged stu- 
dents were participating in Spe- 
cial Needs VocationaTl Programs 
funded programs and services 
during FY 77 This amounts to 
about 6 percent of those enrolled 
in reimbursed vocational educa- 
tion programs in the State" 

— Special Needs Vocational Pro- 
grams were financed (at approxi- 
mately $1 1 .600.000 during FY 77) ' 
through 24 percent Federal. 30 
percent State, and 46 percent 
local sources Appr(?Xtimately 
$1,400,000 of this budget was a 
transfer from the Division of 
Special and Compensatory Edu- 
cation 

— Special Needs Vocational Pro- 
grams were used to finance ser- 
vices at 74 percent secondary, 
24 percent pQst-secondary. and 

_.2 percent adult levels, during 
FY 77. 

— Costs and expenditures for 
handicapped and disadvantaged 
students- participating in regu- 
lar vocational programs (main-~ 
streamed) or special vocational 
instruction programs pgid for 
through regular vocational edu- 
cation aids are largely not-re- 
corded, in- an Identifiable way at 
present 

— Although local contribut*ion is ' 
used to match with State funds 
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to gam use of Fedejal funds, the - • 
management and .monitoring of 
actual use is controlled by the 
local agency and not the Divi- • 
sion of Vocational-Technical Ed- 
ucation 

After reviewing each objective and 
corresponding outcomes, the follow- ' 
ing summary conclusions appear 
warranted about the original pro- • 
posal for the study and results of 
the study- 
About the 3tudy proposal — 

• Ambitious, given tim^ and reeource 
.constraints 

• Over-estimate of immeSiate avail- 
ability aQ(gl completeness of second- 
aryiJata ^durces 

• Agency personnel w^re as coopera- 
iive.as possible, given the limita- 
tions enforced upon the study 

• Under-estirrrated the complexity of 
Selecting iitdicators of handicap- • 
ping and disadvantaging conditions 

^« Under-estimated th.e Complexity of ' 
describing programs and services . 
provided or which could be pro- 
vided by the various human service 
agencies 

Results of the Study — 

• Definitions and guidelines for iden- 
tifying the handicapped are^fOrther 
developed than those forihe dis- 
advantaged , 

• Both causal and functional defi- 
nitions are necessary^ for the handi- 
capped and disadvahraged Causal ^ 
defin|tionS'are oeeded*for account- , 
abjlity and functional defmitions 
to plan special services 

• There is a strd^g need for indi- 

* vidual assess^ment, once defini- 
tion and indicator issues are te- 
solved. to determine. 

(1) eligibility of persons for ser- 
vices, and (2) to determine the 
complete education services nec- 
essary to allow the person to sue- , 
ceed'in^a'vocational program 

• Using present 'indicators, there ap- 
pears to k|g a greater number of 

♦ disadvantaged persons than handi- 
capped persons 



Vocational education is serving a" 
relatiiiely large' number of persons 
who are disadvantaged. " , 
\yithin vocational education, adglt 
level handicapped and disadvan- 
taged persons are served minimally 
in comparison to other education 
levels and th'e total prevalence 
within this age group (age 56 + ) 
There is a large number of agencies 
involved in providing services to 
handicapped and/or disadvantaged 
persons in vocational education 
There Is a strong need for coordi- 
nation of definitions and manage- 
ment information within ^nd be- 
tween these agenGtes 'Consistent 
program and service terminology 
IS needed The manag^erhent infor- 
mation systems need strict com- 
pliance in. data' input and monitor- 
ing of analysts, and output 
In general, handicapped- and ^dis- 
advantaged persons tend to be 
dealt with by separate agencies 
based on eligibility requijenients. 
except for t>ie Spec^al Need's Vo- 
cational Programs which deal with 
both groups " / 
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Synthesis 

THrtOUR STUDIES 

The four studies selected for review contained a number of common 
variables relative to serving special needs students m vocational 
education All four studies contained recpmrYiendations for state-level 
and local initiatifes to improve vocational education efforts op beKalf 
of sfJecial populations The following sections describe and synthesize 
the major findings from these studies. 

Students Served 

The two national studies by the Olympus Research Corporation 
examined programs for the handicapped (1974) and disadvantaged 
(1976) separately. The handicapped study noted that the vast majority of 
students served were classified as "mentally retarded' (77%), with 12% 
of these being ^trainable mentally retarded. " Fifteen percent of the 
students served in the programs studied were physically handicapped 

One of the major problems noted in the national disadvantaged study 
conducted by Olympus was the ambignjity in identification of the 
students to be served Few states or comrtlunitifes had established spe- 
cific eligibility criterja that went beyond the general Fed,eral guidelines. 
Approximately half of the 84 project directors interviewed did not believe 
that the students enrolled were disadvantaged For those students that 
* were being served, the mpst common criterion used for identification 
,was academic deficiency, that is, students who were one or more grade 
fev'els behind thfeir peers. Slightly less than half of the disadvantaged 
students studied were minorities. 

. The Iowa study reported that there were approximately 9,000 
handicapped and disadvantaged students enrolled m vocational edu- 
cation prografris m Iowa 'Of the^e, 65.7% were identified as disad- 
.vantaged. 55 4^o were male DatajA/ere not reported by specific handi- 
capping condition or disadvantagement. However, the most frequently 
cited student problems for both handicapped and disadvantaged 
students were poor interpersonal skjils, low reading ^nd math 
abilities, and poor job-task (performance) skills. 

The Minnesota study used secondary data sourcjes to examine the 
prevale^rrce of special* needs populations in the state. Using a broad 
functionalxlefinltyDn of disability, it was reported that approximately 14% 
of the Minnesota population is disabled with^ physical handicaps the 
most prevalent (by far). Reading below ^rade leyel is the most prevalent 
disadvantagement indicator for secondary and post-secondary age 
group's Triey also reported a higher prevalence^ rate of academically 
disadvantaged students in secondary vocational education programs 
than in the total secondary school population. F.urther. the researchers 
repQj::ted the strong likelihood of a higher prevalency rate of academically 
and economically disadvantaged students in post-secondary vocational 
educatron than in other types of post-secondary education programs 

In Mir)nesota. approximately one-third of all post-secondary vbca- 
Jio.nal education students are handicapped or disadvantaged with 
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approximately 75°o of this group being disadvantaged It was also noted 
in the Minnesota study that vocational education progranns and services 
for ardults with special needs are extremely limited. ^ 

As the awareness of educators increases relative to P.L. 94-142 and 
other civil rights legislation, a growing percentage of the students being 
served in vocational education are identified as students with special 
needs To accommodate these students, efforts will be needed to modify 
regular vocational education programs/o meet the occupational needs 
and learning styles of the individual. In some instances, special or sepa- 
rate vocational programs will continue to be required to serve students 
with severe problems or difficulties. 

Program Environments 

Special needs students are typically served in a range of different en- 
vironments or types of programs. A basic legislative mandate and related 
issue focuses upon the degree of mamstreaming which is occurring m 
vocational education. 

The Olympus d^isadvantaged study found. that two out of every three 
disadvantaged students (approximately 65°o) at both the secondary and 
post-secondary level were m regular classes The Olympus handi- 
capped study revealed that 70*^0 of th6 92 prpgrams studied provided for 
separate, special vocational programsfor the handicapped students The 
Minnesota study revealed that the .identifiable" portion of special 
needs vocational education students at the secondary level are in seg- 
regated classes. However, it was also noted that an unidentifiable group 
of secondary vocational education students who are handicapped and 
disadvantaged are being served through regular Vocational education 
programs via mamstreaming. One of the major reasons cited in the 
studies for the use of special classes was^the^ase of fiscal accountability 
that a special class arrangement provides 

Occupational Programs 

The specific types of vocational programs which are provided for special 
needs students have been a continuing concern The studies reveal that a 
-large percentage of the programs focus on nonskills courses, eg., re- 
medial or prevocational education, world-of-work instruction. The 
Olympus disadvantaged study revealed that 69°o af the secondary 
students and 56°o of the post-secondary^tudents were nof-enrolled m 
skillstraming programs, l^he Olympus handicapped study found that63°o 
of the students were in nonskills programs. Of these students, 52% were 
enrolled in prevocational programs The balance was m programs for 
vocational evaluation, mobility instruction, travel training, sheltered 
workshops, and tutoring 

Those special needs students who were enrolled in vocational edu- 
cation skill training progranris tended to be clustered in' specific^occu- 
pational areas The Olympus handicapped study found the largest 
numbers of students in'trade and industrial education classes (primarily 
male) and home economics (primarily female). The range of training 
enrollments was considerably wider for men than women. The Olympus 
disadvantaged study revealed a disproportionate nurnber of students 
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enrolled m business and office occupations programs. At the post- 
Secondary level. 73°o of the disadvantaged errfollments were in this 
Qccupatiopal program. At the seco,ndary level, 36% of the enrollments 
wepe in office and business programs. 

P L 94-142 sets an important precedent ior aULspecial populations by 
requiring that full educational opportunity be|provided. In essence, 
special needs learners must have equal access [g any vocational edu- 
cation program [Provided by local education agencies Major efforts are 
needed to overcome the traditional occupational Stereotypes associated 
with certain handicapping conditions. Parents and special needs 
students must be provided with comprehensive, but nondirective career 
guidance services that will aid them in making Meaningful educational 
and employment choices. " ! > " 

^ Cooperative Work Experience Programs 

Co-op programs that permit students to be errlployed for part of the 
school day have been a popular programming arrangement for providing 
special needs students with occupational sMIs. Forty-seven percent 
(47^b) of the 62 disadvantaged high sch))ol projects studied by 
Olympus had a work education component^most lialf of the students 
were enrolled in work experience programs However, at the post- 
secondary level only 4% of the programs provided work education 
opportunities for the disadvantaged In trfe national study of handi- 
capped programs. 20''o of the projects were identified as primarily 
work experience programs That is. a majority of the students worked 
on part-time jobs However, in an additional 30% of the programs, 
some handicapped students were referred to a work experience class. 
In both of the Olympus studies, major concerns regarding the quality 
of the work experience program were cited. Specific concerns were 
related to the lack of written training plans'and the marginal relation- 
ship of yne on-the-jOb experience to the in-school vocational education 
progrannT 

The Iowa study indig^ted that more than 56% of the special needs 
students being served in vocational classes had available to them a 
special education work study program, as well as other work experience 
programs. ^ ^ 

Identification and Assessment 

To systematically and effectively serve special students, procedures for 
Identification and assessment of learning problems are essential. The 
studies identified several problems related to identification and 
assessment of speciahneeds students. 

The Olympus handicapped study found that students were evaluated 
and classified by special education personnel long before they were 
referred to the vocationafpro^ram. Very rarely w6re assessments (e.g., 
occupational interest or aptitude) done by vocational educators once 
^students were referred Labeling was found to be a concern among the 
educators interviewed and a resultant^rend toward the classification 
of students as special needs" students was noted. Similar problems 
existed in the Olympus study of the disadvantaged programs. There was 



a lack of criteria for identifying disadvantaged student^and ^ corre- 
sponding lack of adequate assessment procedures for 4|termining the 
conditions. whifch cause school failure. 

In^the loWa study, the 1 ,265 vocBtipnal education teachers responding 
noted a major need for assessment and diagnosis skills. Teacher in- 
service activities inl^lving diagnosis of individual student needs" was 
clearly marked as the highest inservice trainipg priority. 

The Minnesota study noted several global special needs assessment 
problems from the secondary data that were examined First, def iriitions 
and indicators are more specific and consistent across levels of gov- 
ernment and agencies for handicapped than for disadvantaged persons 
Considerable variation in expertise, information, and technology \s 
needed to identify disadvantaged and handicapped students Special 
needs students can be identified in terms of causal and effect (functional) 
characteristics. Knowledge of functional characteristics seems of most 
concern to vocational education. 

It appears that strategies for identification and assessment of special 
needs students continue to be a mystery for vocational educators The 
need to understand the functional educational needs of special students 
prior to instructional planning is widely recognized To ensure 
appropriate vocational instruction, much more must be known about th6 
special student by the vocational educator thanjs presently known 

Interagency Coordination 

Historically, a number of federal and state agencies have p^rovided 
services to individuals with special employment or educational 
problems. With the involvement of several agencies and proffessionals in 
serving a common individual or group of special needs individuals, a 
potential for duplication as well as gaps in service delivery exists This 
problem of coordination has plagued special needs vocational education 
on or Within school level, as between the school and community-based 
agencies. 

The Olympus disadvantaged study recommended that local vocational 
administrators should be required td coordinate their p^rograms with 
other agencies (school and nonschool) which provide services to the 
target population. This study found little evidence of inter^lgency or 
comprehensive planning Tor handicapped studejits in vocational edu- 
cation at the local or state level. 

-In times of public fiscal restraint it becomes imperative that programs 
and services'for special groups be efficient and cost-effective Coordi- 
nation between and among vocational, regular and special educators. 
CETA personnel and vocational rehabilitation is essential for the 
functions of referral, assessment instruction, support services, eval- 
uation, placement, and funding 

St^f Attitudes ^ - ' 

The involvement of special needs individuals in vocational programs is a 
new experience for most vocational education teachers The extent to 
which teachers are supportive or nonsupportive of district efforts to 
serve these students is critical to overall program success 
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The Iowa study of vocational education teachers revealed that approxi- 
mately one-third of therteachers were not supportive of the concept of 
integrating or mainstreaming special needs students. Approximately 37% 
said that every effort should be made to integrate special students, while 
24 indicated that they did not hold ^ny strong feelings in either direction. 
The Olympus handicapped and disadvantaged studies did not examfhe 
staff attitudes directly, but' noted that one of the most frequently 
mentioned constraints limiting the expaijsion of vocational programs for 
the handicapped was the reluctance ofregular class teachers to accept 
the special needs students. 

It-would appear that continuing efforts are neede^d, through inservice 
programs, to assist in developing posftive teacher attitudes toward 
serving the special needs stude^nt in regular vocational classes. 

Preservice and Inservice Training 

These studies clearly substantiate the mjmerous recommendations 
^ftered in the literature regarding the major and continuing need for the 
TfaWng efforts The Olympus disadvantaged study recommends that in- 
service training for all staff, delivered either by state personnel or by 
contract, must be provided. Teacher training institutions should be 
involved in inservice activities, as well as in efforts to make appropriate 
changes in the preservice curricula for preparing vocational education 
teachers The Olympus handicapped study emphasizes the need to 
provide vocational instructors with special education techniques to 
effect program expansion as well as to improve prdgram quality. 

The Iowa study examined the inservice and preservice training needs 
in greater depth and offered a series of key recommendations The need 
of "awareness level" inservice activities was stressed for a// personnel 
involved in vocational educ^on at the local, community college, uni- 
versity, and state levels In acTdition, "how-to-do-it" inservice experiences 
were identified as heeded for identification and assessment of spetcial 
needs students, developing individualized instruction, monitoring and 
evaluating student progress, and conducting follow-ups. The use of 
several diverse inservice approaches, including local team involvement 
and observation of innovative programs, was recommended. 

State Education Agency Man'agement 

Since the mid-'^i^^'s. state departments of education have undertaken 
increasingly complex roles and responsibilities relative to administration 
of the federal programs of vocational education and special education. In 
various states, different arrangements have been developed for funding, 
administration, evaluation, monitoring, technical assistance arjipther 
state-l^vel functions The Olympus studies and the Minnesot^Btiidy 
examirued several key variables relative to SEA management. 

The following are some observations and recommendations from the 
Olympus studies which appear to be points of agreement concerning 
state ^dmiriistration: 

• Clear and articulate policy issuances regarding comprehensive 
vocational education for special needs populations were lacking. 
Planning is short-term in nature and usually directed at justifying 
certain projects. 
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• The majority of the states spend their vocational education set-aside* 
funds for the handicapped and disadvantaged on a project basis Local 
districts and post-secondary institutions develop and submit funding 
proposals for programs that they wish to operate to serve special, 
needs youth. Block grants to local education agencies wasthe second 
most frequent method of funding used by the states, 

• Planning, monitoring, and evaluation of projects and programs was 
handled on an informal basis. The number of special needs state staff 
assigned to these activities was frequently limited thus severely 
linniting comprehensive, in-depth planning and monitoring, 

• Stateeducation agencies responsible for vocational education appear 
^ to need assistance in interagency coordinatii^n, improvement of 

management information systems, and interactions with state advisory 
councils and panels, 

SPECIAL NEEDS RESEARCH. PRIORITIES FOR THE 1980's 

This review has presented and analyzed -four major studies focused 
on vocationalfeducation for special needs populations. These studies, 
as well as others, suggest a large array of continuing issues and 
problems requiring'research. It is interesting ^fo note that serving 
special needs students is a continuing priority in federal agencies such 
as the Bureau of Occupational and Adult Education' (BOAE) and the 
Bureau of Education for the Handicapped (BEH), The most recent 
listing of proposed BPAE research priorities: in the Federal Register 
(June 13, 1974)Jists serving special needs students, basit skills, and 
vocational equity ens among the eight national priorities — all of which 
havedirect implications for improving vocational education's capacity to 
serve special groups. The Bureau of Education for the Handicapped has 
'considered vocationalcareer education as a priority in their teacher 
training and field-initiated research programs since 1974 Numerous 
other federal agencies, such as the U,S, Department of Labor, the Office 
oKCareer Education, and the National Institute of Education,, have pro- 
vided leadership for research on the career development and em- 
ployment of special populations. Without queslion. one'^ can "review the 
research prionties of these agencies for the past seven to ten years and 
find some level of funding commitment, 

' Research Priority Conferenpos 

Conferences and conventions typically provide opportunities for 
exchange and dissemination of research 4n recent years, however, 
several conferences have been held to review and jdentify specific re- 
search priorities in this field, ^ 

In January 1975 the Bureau of Education for the Handicapped 
sponsored a conference at Princeton University entitled "Career 
Educatiori for the Handicapped" to identify top-level research priorities 
(Doty, 1979), The participants focused on seven major areas of concern 
attitudes, critica< incidents in employment, communication and pro- 
fessional interaction', mobilhy, demonstration and dissemination, 
decision-making, and employability. In follow-up to the Princeton 
Conference, a second' BEH-sponsored conference was held at 'the 
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University of Kentucky \ty^ 976 (Appell. 1 976). Among the topics Identified 
as needjng future r/esearch were: 

1. A definition of career, education which incorporates those compo- 
nents necessary for successful working and community living. 
;2. How and when the assessment of career potentials of handicapped 
students could be conducted. - . 

3. The development of the career education process for various handi- 
capping conditions. 

4. Development, dissemination, and utilization of career education 
project efforts. 

In October. 1979 a gcoup of 23 individuals representing the Big Ten 
Universities met at the University of Illinois to discuss research related to 
the career development of special populations The two-day meeting 
focused predominantly on basic research needs. Among the major 
research problem areas identified were. 

1. Assessment of the impact of preservice and inservice teacher edu- 
cation efforts. ' 

2. Assessment of the longitudinal effects of vocational programs on 
special needs students and related populations. 

3. Validation of teaching methodologies. 

4. Evaluation of learner assessment practices. • 

5. Development of functional diagnostic procedures to identify unique 
learning peeds of special populations. 

6. Assessment of the effects of interdisciplinary and interagency 
strategies. 

7. Adaptation or adoption of research paradigms from other disciplines 

8. Validation of attributes of successful teachers and employers workj^ 
ing with special needs [Populations. 

Some Critical Research Needs 

The four studies presented in the review, as well as insights provided by 
the review of literature, suggest that there are at least four major studies 
that should be initiated, 

1. There exists a major need to assess the efficacy of vocational edu- 
cation programming and services for the handicapped and disadvan- 
taged. The most recent comprehensive national assessment stiidies 
were conducted by the Olympus Research Corporation in 1 974 and 1976 
prior to the 1976 Amendments. Major re-directions have been initiated by 
P.L. 94-142. Section 504. of the Rehabilitation Amendments of '1974, 
Youth Employment and Demonstration Projects Act (YEDPA). and P L ' 
94-482. Little i& known on a national level about the na^re of the occu- 
pational program eni-ollments, types of students served, program 
completers and leavers. Administrative and management systems, 
recruitment and intalj^e procedures, staffing, interagency efforts, fundihg 
patterns, employer satisfaction, and alternative programming models A 
national assessment study, or series of studies, of this nature should 
examine programming fqr the handicapped, disadvantaged, native 
Americans, and limited English speaking on both a state and local level 

2. The 1976*Amendments peVmit states to use Subpart lll-Program<k 
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Improvement and Support Services funds on national priority programs 
Many states appear to be using this option to fund teacher training and 
curriculum development projects related to sRecial needs populations 
Sharing and dissemma\ion of these project efforts across states could be 
significantly enhanced if a project was conduc.ted to identify ,-describe. 
Catalog, and disseminate the funded program improvement activities 
dealing with special needs populations. Such a project would also 
Identify the extent to which the various program improvement and 
support service functions (research, curriculum development, guid- 
ance, personnel development, innovative and exemplary, and sex bias) 
are focused on special needs populations. 

3. Local pjogram evaluation practices are strongly emphasized in the 
1976 Amendments (Section 1^4-401). SpecrttTally, states are required to 
examine the results of additional services that are provided under the 
Act to the following special populations, women, members of minority 
groups, handicapped persons, disadvantaged persons, and persons of 
limited English speaking ability." A national study which examine^the 
states .efforts to date in this area W/Ould help to determine (1) types of 
evaluation strategies being used, (2) level of support services being 
provided; (3) problem areas in serving special population, and (4) 
recommended improvements in federal legislation and regulations 

4. There has been a continuing debate in the field regarding a specific 
target population approach (e.g., handicapped) versus a ^'special needs" 
approach to serving those ide^ntified in the national priority programs 
section of the 1976 Amendments. The basic question focuses on the 
extent which programming models, instructional and counseling strat- 
egies, and support services are similar or different A study which ex- 
amines the potential commonality of these strategies could greatly 
increase the efficiency of teachers and administrators in dealing with all 
special needs populations. 

A Research and Program Improvement Paradigm 

The development of paradigms that outline the critical dimensions of a 
particular field is another approach for examining research priorities 
With rapidly emerging mandates to serve various special groups and an 
expanding body of knowledge, it is imperative that research efforts be 
comprehensively planned and coordinated The paradigm presented in 
Figure 1 presents a model for contrasting research and program im- 
provement activities across the major delivery system components 
involved in serving the vocational education needs of special popu- 
lations. Within each cell the reader could, identify existing research 
projects related to serving special needs learners. The matrix can also be 
used to identify needed program activities. In those cells where project 
activities cannot be identified, perh^s exploratory needs assessment 
studies are warranted. Other cells may show several existing prefects 

The comprehensiveness or coordination of program improvement 
activities can be illustrated via the paradigm also. For example, it is pos- 
sible to examine the need for and elements of effective interagency 
cooperation at the local, state, and federal edlication agency levels 

Continuity of program improvement activities is also an emerging 
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FIGURE 1 

A Research and Program Improvement Paradigm 
forj/ocational Education ajiid Special Populations 

Program Improvement Activities 



Delivery System 
Component and 
Functions 



Local education agencies * 
(secondary and post-secondary) 

• Recruitment and intake 

• Identification processes 

• Learner needs assessment 

• Support services 

• Individualized programming 
Inservice/staff development 
Coordination of community resources 

• Learner progress assessmerit 

• Cooperative work experience 

• Other processes 

Special vocational school programs (for 
severely handicapped disadvantaged 
populationdt 

• Severely handicapped programs 

• Corrections programs 

• Job Corps 

• State schools for the blind deaf 

• Other program&schools 



State education agencies 

• Funds distribution 

• State planning ' 

• Policy development 

• Evaluation 

• trfteragency cooperation 

• Monitoring 

• Program improvement and support 
services 

• Technical assistance 

• Other functions 



Federal education agencies 

• Policy formulation and dissemination 

• Techn^fal assistance to states 

• Monitoring and evaluation 

• Program improvement activities of 
national significance 
inter- and intra-agency policy 
development 



leather education institutions 

• Preservice training 

• Inservicc traflning 

• Graduate education ^ 

• Research - 

• Service 

• Other fiif>ctions , 
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national concern (Cheney-Stern & Evans. 1978). Once critical research 
and development needs are identified, continuous efforts must be made 
to develop appropnate programs or curricula, test and validate, dis- 
seminate, and evaluate the research products To achieve their maximal 
impact, major research needs or problems need tote translated into 
materials, resources.^nowledge. or products that practitioners can use 
to improve vocational opportunities for special needs youth and adults 
To address systematically research and program improvement needs, 
the profession needs to examine the process comprehensively As the 
columns in the paradigm suggest, program improvement involves a se- 
quential process (1) a determination of needs. (2) curriculum and/or 
program development. (3) validation of curriculum and program models 
via demonstration programs. (4) dissemination and utilization activities, 
(5) installation in preservice and inservice personnel training programs, 
aridT6) evaluation of the program improvement activities for a selected 
research priority, as well as for the total program improvement process 

States and local school districts should annually review their pro- 
grammatic and research needs in providing vocational education to 
special populations. As the Iowa and Minnesota studies revealed, there 
are a number of needs that can be reveated on a state-wide basis, Further, 
the Iowa study generated needs assessment data frohi vocational 
teachers that locaUadministfators would find useful in planning addi- 
tional support services, initiating new programs, or planning staff in- 
t service sessions. 

Once the major needs relative to programming for special needs popu- 
lations are known, efforts can be undertaken to develop innovative 
programs, new curricula, new instructional materials, etc With major 
efforts being initiated toward mainstrea'mmg, several inservice-staff 
development programs have been developed to assist vocational edu- 
cators to deal with special needs students Development of curriculum 
resource. materials focusing on teaching basic skills (eg . vocational 
reading and vocational rpath).to special needs students has also been 

• initiated. " ' u • i 

The third phase of the program Improvement process should involve 
testipg. validation and appropriate revision df'the'^program or curriculunf) 
^ model. This can be^ achieved in a variety oi ways, but \\ is usually done 
in the form of a demonstration program. As noted in the review, nu- 
merous curriculum materials and instructional packages for special 
needs students in vocational classes have been developed Most of these 
have focused on individualizing vocational instruction for handicapped 
and disadvantaged students (Hull, 1977). Several national and state 
agencies (most notably the Bureau of Education for the, Handicapped) 
have prepared descriptions of exemplary, programs It appears, however, 
that few instructional or curriculum packages or exemplary t^rograms 
have been tested or validated (with^ppropriate daia collection) to de- 
scribe their long range outcomes Part of this fack of data is attributable 
to the recent development of thejield. Training and resource materials to 
assist vocational special needs professionals in designing and testing 
^^demonstration programs and materi'^ls is critically needed 
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Following the testing and validation phase, a comprehensive planning 
for dissemination of the model, concept, material, etc shoul(;l oci:ur 
Many research and development products (e.g^,^ instructional material 
bibliographies*, teacher guides, state planning guidelines, etc) do not 
achieve their maximum impact because of fragmented or incomplete 
dissemination. A comprehensive dissemirxation plan should include 
strategies for dissemination via. (1) national information and dissemi- 
nation systems (e.g., ERIC. The National Center for Research in Voca- 
tional Education), (2) state, national, and \oca\ conferences. (3) articles 
in journals and newsletters, and (4) other project-related activities 
(e.g. specially-designed workshops). During the design and develop- 
ment^'phase of the project, serious consideration must be given to the 
user audiences and their,organizations in which they work. During the 
testing phase various techniques for obtaining administrative support, 
financial support, and adoption of the concept should be examined 

Research and development projects focused on improving vocational 
education for special needs populations have been short-sighted in their 
dissemination and utilization plans. That is, thedissemination efforts are 
focused on a primary group such as vocational education teachers or 
special education teachers. Dissemination workshops and other activi- 
iies should stress the cooperative involvement of vocational educators 
with the specialists involved in serving the special needs student at all 
levels. Parents, counselors, administrators, advisory committee and 
school board members should plav active roles in/hedissemmation and 
adoption of new strategies for serving special students. 

To ensure the full adoption of knowledge and products developed via 
research and development projects, efforts to tram .and re-tram per- 
sonnel are needed. The Iowa study and national Olympus studiefs pointed 
out the major and continuing need to prepare vocational teachers and 
administrators to deal wjth special needs students Certainly, this need 
has been created more in response to the legislative mandates for main- 
streaming, than for the need to adopt new research products However, 
one can also observe that this need has generated a number of com- 
prehensive research and program improvement activities focusing on 
personnel devefopment (e.g'., research on needed teacher competencies 
(Albnght. Fabac and Evans, 1978). development of inservice and pre- 
service programs (Meers. 1977; Hartley, 1977) ). 

Within the paradigm the inservice, preservice training phase is directly 
related to utilization. In most instances, if research products are to be 
effectively utilized, training must be provided to the personnel respon- 
sible for their implementation in the classroom or other appropriate set- 
tings. As projects are developed and products tested, extensive consid- 
eration should be giveri to addressing (l)jWhat competencies will be 
needed by teachefs or othersto implement the research product(s)'^. (2) 
How can the researchi)e built into university teachertraining programs'^, 
and (3) How can the vocational or special education teacher be prepared 
to use these new materials? Obviously, this requires that university and 
college personnel who are involved in teacher training be involved i-n at 
least the dissemination asp^rct of research and development projects 



Increased involvement of teacher educators in research and program 
improvement activities shoiTld facilitate tha use of research products in 
undergraduate and graduate courses. 

Evaluation is the final program improvement activity in the cycle. Once 
the research and development product(s) h^is been disseminated and 
some degree of irtilization has occurred, there must be a continuing 
' commitment to assess the impact of the product(s) Section 104 704 of 
the federal rules and regulations for the Vocational Education Amend- 
ments of 1976 requires that state-funded research projects demonstrate 
as'^reasonable probability that degree of the contract will result in 
imj^roved teaching techniques or curriculum materials ttiat will be used 
in a substantial number of classrooms or other learning situations within 
|nife years after termination date of the contract." This, and other 
i^ndates for educational accountability, place a greater emphasrs on 
evaluation of program improvement and rfesea^rch activities. Follovv^-up 
studies of research efforts will help to insure their continued use 
^appropriate improvements can be made in research products if orga- 
nized efforts are made to monitor and evaluate their use over at least a 
/five-year period. 

Program evaluation aotivities. in themselves, can be viewed as pro- 
gram improvement activities. State boards of vocational education also 
* have a mandate to evaluate, at least once every five years, the vocational 
educcition programs. receivmg federal, state, and locai vocational edu- 
cation funding. A part of the evaluation involves assessing the impact of 
support services provided to special populations. Similar local evalua* 
tions are required of special education and CETA programs under fed- 
eral legislation. The results of such evaluations can be extremely helpful 
in identifying research and program improvement ne^s within the 
local district. Policies and systematic efforts are needed to insure that 
these results are used at the local and state levels to determine research 
needs, teacher training needs, and curriculum and/or progrsi^m develop- 
ment needs ^ 
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Research Review 

« 

THEORY CONSTRUCTION AND THE DEEP STRUCTURE 
OF THEORY IN CAREER DEVELOPMENT 

The structure of these Annual Reviews qf Research in Vocational Educa- 
tion (ARRIVE) offers muc h to readers interested ui the structure of scien- 
tific revolutions (Kuhn, 1970) as we presume you to be ^ 

Research has both substantive and procedural climensions The co- 
editors have elected toconstruct this revievy so that it illuminates research* 
in career developmentduring the pa§t fiveyears in both thesedimensions 
Of the two, the hardest to illuminate is the substantive dimension 
Research'ordinarily bears some, but not a greatdeal of. relationship to 
the deep structure of theories. But the goal of science is to perfect the 
deep structure of generalizations bearing upon one or another phe- 
nomenon observable in the natural order of things, events, and the 
actions of persons in events. 

Since, we seek further perfection of the theory of career development 
m this review, we must depart from the assigned structure for all reviews 
\r) ARRIVE in two ways. The first such departure is to sketch at the outset 
the deep structure of theory in career development which has evolved in 
the past 30 years, the period since the last revolution in the theory shpok 
up the basic paraidigm upon which the deep theory in career development 
currently rests. The second departure from the assigned structure 
appears m the concluding synthesis section, in which we attempt two 
rather than one syntheses. The first synthesis we provide is that of the 
literature summarized in the next section and of the lighthouse studies 
included m the third section. This synthesis is made in terms of the 
present deep structure of career development theory A second syn- 
thesis offered in the concluding subsection arises from 1) differen- 
tiation of decision from choice as a foundational par^diflm for theory 
m career development, and 2) reintegration of work on decision 
making development which Tiedeman and his colleagues have pub- 
lished over the last 15 of 30 years. Our intention is to change the basis 
for theory in career development from investigation grounded in oc- 
cupational choice to investigation grounded in personal compre- 
hension of career as a construction perfected throughout life For our 
purpose, and for the purpose of providing context for the summariza- 
tion of research m career development di the last five years, we next 
construct an overview of the present deep structure of career develop- 
ment theory. 

A deep, structure of theory in the career development of males has 
formed throughout the past 30 years. The process of occupational 
choice in-childhood, adolescence and young adulthood, formulated 
by Ginzberg, Gmsburg, Axelrad, and Herma (1951), was first placed 
into a more extensive structure by Super (1957), who made the self 
concept the locus of the 'Occupational choice process and specified 
a very broad developmental framework within which self concept and 
occupational choice, interact. Roe (1956) and Holland (1959) contributed 
n^eeds satisfaction classifications of occupations which have a com- 
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nsional ba^se and associated circular assumptions about 
ip of personal needs and occupationaJ choice^, although . 
tional classifications are not identical. In aciditiop. Roe 



icipate later occupatronal^choice from ^the home climates 
rsons are raised while Holl^ci worked assiduously ory^e 
s in which persons choose to operate in order to increase 
the relationship between peoples inventoried'preferences prior to em- 
ploymen/and the kinds of occupations they later pursue 

Both Srites (1969) and Os'ipow (1973) subsequently dr^w this serjUnal 
work toJgether. Crites' monumental treatise on vocational psychology 
orgamaes the essential research literature up to abo^ut the turn of the 
presery: decade. As a result of its emphasis upor\ rese^irch. Crite^ has 
to div/de the study of vocational psychplogy essentially into sfudies 
of vocational chofce and studies of vocatior^al adjustment. The work 
rgports on vocational and occupational cnoice gives some atten- 
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0 studies of thoice-related vocational maturity and development 
ection on vocational adjustment attends tc> the plethora of studies 
ng with vocTational adjustment, motivation, success, and satis- 
lon, essentially independent concepts wi^th which the f^eld has been 
gued because iuch studies are not generally organized-into any kind 
personal developnrientj^il^ontext. Whether career development de- 
elops or not remains a moot point for mapy investigators, but th^ field 
hi career education blithely proceeds on the assumption that career 
can develop, at least ifjj^elped to do so. 

In his 1968 boolTfrevis^d in 1973). Osipow attends to the theories of 
career development, rather than the theory. Together, the Crites and 
Osipow books provide a firm foundation for current beliefs in career 
psychology. Osipow summarizes the theory and research 'bearing oh 
seven different cpnce^Dtions which are currently used in construing 
various aspects of vocational behavior. Crites attempts the more ambi- 
tious, andiherefore more ambiguous, task of inducing a theory of career 
development from its research. Actually^, the generalizations about 
career development which we can derive and observe without exception 
require both keen attention to what we seek to know and keen thought 
about the way in whichyiose effects appear in the natural realm This ts 
why we organize^ttTt?7eview as we do. 

In the next section, research i^career developcnent which has been 
pulDlished Since about 1975 is^josed to infer what seems to be going on 
in reseafth toward advancing cUrrent understandings of career develop- 
ment. We, have selected four studies which h^ve been thrown by their 
authors into the pond of currenf belief about career development theory 
and advance several observations on the rippies they seem to create in 
that pond Finally, vye attempf synthesis of both the recent research and 
the recent challenges of career developijient theory Our theme will t)e 
that of decision making development ^s it manifests m the career Con- 
trary to popular belief, choice and decision are^ot alike Choices are 
preferences either for individuaNy-derived options ortfor options offered 
by others. Decisions, on the other hand, are action sets which are 
grounded in individually evolved choices The co-editors believe that 
individuals can come to comprehend both their decisional processes 
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and the developments o.f their decisions. VVe use that theme as a syn- 
thesizing e)j?ment of the work on career development research we review 
By doing ^o. we^hope to create a few ripples of our own irt the pcmd of 
current beliej about career development theory^ These ripples, in their 
integratior} around decision making development in career rather than 
around choice development, as at present, can haVe the affect of causing 
our present career development theory pond to overfJqvy and re-estab- 
lish lis basic deep structure, thereby having effected a scientific revolu- 
tion m the basic paradigm in which we conslrtict theory in career de- 
velopment 

J 

RESEARCH: 1975-1979 

* 

The October issue of the Journal of Vocational Behavior has contained 
a review of career development research for each of the past several 
' years These reviews, and the review of journals and educational docu 
ments which the authors undertook to augment them and bring them 
up-to-date, indicate expanding attention on consistent topical threads 
fo> the period 1975-1979 and are used to organize this section 
■ Without question, professional journals continue to be frequented 
with further elaborations and e^minationsof career development theory 
m the continuing search for a comprehensf/e and more general model 
However, that emphasis is complement^' by the increasing attention 
which IS being given to the development and assessment of delivery 
systems to foster the development tJf career The research literature 
also contains a constant stream of evaluations and explorations of as- 
sessment instruments which measura-rmteresl.' occupational choice, 
career maturity, career skills, and self-estimates Apart from these tradi- 
tional areas of career development research, the 1975-1979 period of 
investigation marks noticeable gams in the study of sex roles, and the 
impact of sex-stereotyping on caree/ development Career development 
for females is gaming attention eqjal to tbat traditionally given to the 
career development of males. In, addition, the noticeable effort given to 
the collection of data about the process of career development for 
women, minorities, and adults, as well as the study of career indeci- 
sion and mid-career change, leads one to, conclude that the period 
from 1975 to the present bears considerable fruU 

Elaboratrons.and Examinations of Career Development Theory . 

During jthe past five years, several investigators have proposed n§w 
theories of the deep structure of career development. Crites (1976) con 
tinued effort begun in hi$ 1969 book on vocational psychology to for- 
mulate a general model of career development within which it might 
prove possible to organize the variety' of research now being under- 
taken on ihe'subject His 1976 theory elaborates upon that model and 
takes advantage of the considerable work on vocational maturity which 
he completed in the interim-. 

Kruqiboltz. Mitchell, and Jones (1976) propose that career decision 
making be understood within a social learntng framework Their paper 
on this subject is offered in the next section as one of the stones we 
throw into the pond of current belief in career development which is 



likely to cause more than a few ripples 

Peatling arid Tiedeman (1977) go beyond Krumbolt^. Mitchell, and 
Jones by proposing a self constructionist group model bi personality 
reconstructionism within which they bfelieve that tFie self develops in 
the social context outlined by Krumboltz, Mitchell, arid Jones This ^ 
theory specifies the identity element and the four generating elements " 
which leacl to mature operation of personal involvement in the develop- 
ment of career, no^ just personal presence in the development of career 
Jiedeman and Miller-Tiedeman (1977) and Miller-Tiedeman and Niemi 
(1977) deal further with this concept of personal empowerment in career 
m a two-phase primer on theory and practice. The Peatling and Tiede- 
man book builds upon another by Dudley and Tiedeman (19^7) m which 
those authors thoroughly discuss th.e^process of exploration and 
commitment in careier development. Dudley and Tiedeman's major in- 
terest IS in the relationship*uf structure and' function as n operates, in 
creativity They particularly examine those cognitive processes which we 
experience in the hierarchical restructuringof ourthoughtand of actions 
based in thought. 

E)jam'mation of the-Krumboltz. Mitchell, and Jones model in the fol- 
lowing section will reveal its consistency with behaviorism Crites. Hol- 
land, Krumboltz. Mitchell, and Jones are all investigators trying to .in- 
fuse th^t element into a theory of career development seeminglv rife 
with non-mvestigable. self conceptions* Thoreson and Evart (p^) 
joined these investigators in that purpose during the review's periocTby 
stressing the application of behavioral self-control in career counseling 

General theories on the career stages which women expenence also^ 
started to appear in the'' period under review Brooks (1976) constructed 
a system of transition for the mature woman re-entering the career 
world Based on effective decision making, she indicates that women, 
m contrast to men( experience seven stages during which they must 
Overcome low self-confidence, time management problems, role con- 
" fhct$ and guilt. 

On a less broad conceptual level. Knefelkamp and colleagues ad- 
vanced models by which one can work with the cognitive complexity 
*'of an individual s career conceptions in programs designed to advance 
career maturation (Knefelkamp. & Slepitza. 1976. Knefelkamp. Widick & 
Stroad*. 1976) Baumgardner (1976) focused attention on thinking onen- 
tation Schoon (\976) emphasized affect in the study of career choifce. 
and Dawis and Lofquist (f976) further elaborated their theory of work 
adjustment 

The esseniial question m a theory of career development is whether 
the career develops or not During this period. Hershenson and Lavery 
(1978) gathered further support for their proposed sequencing of devel- 
opmental stages in career. Hall and Mansfield (1975) did much the same 
as security needs increased while self-actualization needs dissipated 
among workers undergoing work function adjustments Kapes and 
Strickler (1975^ in comparing the longitudinal development of occu- 
pational vaTues found increasing strength in the work values of gfade 
nine to twelve students. Wijting. Arnold, and Conrad (1977) generally 
found work values to change in both degree and nature as predicted 
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in sttidents advano^g through the educational system. Dietrich (1977) 
found sinnilar resjalts among nursing students as their work values 
shifted from an ^xtrihsic to an intrinsic nature during their transition 

. from freshman to senior year. , ^ 

Munley (1975^, studying the psycho-social development 6i careers 
found vocational development following the context and developmental 
theory otErikson. In a re:examination of Ginzberg's work, Howell, Frese, 
and Soihe (1 977) found movement from fantasy choice to realistic antici- 
pation occurred ^as a result of perceived reality factors which inhibited 
the maintenance of aspirations. It appears that much of the current 
effort to establish a comprehensive model of career development theory 
begins with adding water tXD old soil rather than with equal efforts to add 
new strains of fertilizer as well. The latter notion is argued throughout 
this paper as the authors work to turn research on career develop- 
ment toward new directions in the quest for a comprehensive model 
grounded in a decision paradigm rather than in a paradigm of choice, as 

Jiie current deep structure of career development theory is. 

Research on occupational choice in career development continued 
to offer generalized support ?or Holland's assumptions about the six 
areas of human needs which work environments satisfy (Andrews, 1975, 
Holiand. Gottfredson & Nafziger, 1 975, Walsh & Hanle. 1 975. Westbrook, 
1975, Yonge & Regan, 1975, Holland & Gottfredson, 1976, Mount & 
Muchinsky, 1978). 

■ In addition. Turner ^nd Horn (1975), Yom, poughtie, Wei, Alston and 
Wakefield (1975) and Wakefield, Yom, Doughtie, Chang and Alston 
(1975), concluded that Holland's theory operates in black college stu- 
dents and in Mexican Americans as well as it does in white males gen- 
erally. The general robustness of Holland's theory was additonally 
sustained among employed non-college degreed women (Matthews & 
Walsh, 1978) and non-professional workers (Salomone & Slaney, 1978) 
* Although investigated much less frequently, Roe's occupational clas- 
sification theory was upheld in an investigation reported by Medvene 
and Shueman (1978). ^ 

Interventions Promoting Career Development 

Since 1975, maturing interests in career education have procjuced nu- 
merous investigations evaluating interventions in personal career de- 
velopment* As the United States Office.of Education continued to pro- 
duce its Monographs in Career Education to serve as a forum for debate 
^ among those tending to the implementation of career education, Peters 
and Hansen (1977) offered their third anthology which provided access 
to articles providing encouragement for career education and guid- 
ance efforts. 

Holcomb and Anderson (1977), however, concluded an analysis of 
vocational guidarice from 1971 to 1975 by finding an imbalance in re- 
search and interventions related to sp'ecific career development prob- 
lems a^pckpopulations. College students served as the principal persons 
studied at X[\e expense of the aged and unemployed. Results suggest 
that more research should examine (1) non-school populations, (2) ca- 
reer counseling processes, methods, and outcomes, (3) vocational in- ^ 
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formation, and (4) attitudes afid processes necessary to niake a voca- 
tional decision. v . ' \ 

As a result of varied career education interventions with .students in 
general, Omvig, Tullock. and Thomas (1975) found significant growth 
in career maturity on the Career Maturity Index (CMl) that Bergland and 
Lundquist (1975) didn't find in minority students. Flake. Roach and 
Stennid (1975) increased self-appraisal and Egner and Jackson (1978) 
improved career tnaturity and decision making scores through coun- 
seling program interventions. Fisher, Reardon and Burck (1976) in- 
creased information-seeking behavior through videotape usage, and 
Mendonca and Siess (1976) successfully treated^career related anxiety 
Reports from Krivatsy and Magoon (1976) supported t^he use of the* 
Self-Directed Search (SDS) to decrease career indecision while ZeneY 
and Schnuelle (1976) applauded both the Vocational Preference Inven- 
tory and the Self-Directed Search for auirming and expanding occupa- 
tional choices. Additionally, CoQaeiJ>^76) found support for the Non- 
Sexist Vocational Card Sort as a device which expanded occupational 
options and career seeking behavior. 

Malett. Spokane and Vance (1978) found that offering brief career 
information to male college 'freshmen increased congruence in mea- 
sured interests of low congruent counselees but Remenyi and Fraser 
(^977) found that a similar program had a leveling effect on occupational 
statu^fperceptions of university students. Oliver (1977) found individual 
test interpretation to be more satisfying than multiple and programmed 
modes,. By employing a Personal Achievement Skills program with 
rehabihtation clients. Roessler, Cook and Li Lillard (1977) recorded an 
increase m attitudes related to gaining employment. Hollandsworth, 
Dressel and Stevens (1977). in studying job interview skills, indicated 
that behavioral training in increasing eye contact in dikujssion groups 
fostered the ability of job seekers to e)jpress attitudes and feelings in 
job interviews. As computers in guidance gained mentorious attention. 
Harris-Bowlsbey (1976, 1978) published several papers on her new 
DISCOVER System and Chapman (1977). and Risser and Tulley (1977) 
did the same with SIGI (System for Interactive Guidance and Instruc- 
tion). Cochran. Hoffman. Strand and Warren (1 977) found that computer 
guidance by means of SIGI had positive effects on college major selec- 
tion but not on career choice. 

The literature in career development was enriched by Campbell, 
Rodebaugh and Shaltry s (1978) handbook of programs, practices and 
• models which succinctly reviews significant career guidance tech- 
niques and delivery systems in secondary schools Also. Drier, Davis. 
Hartz. and Stem in The National Center for Research^ in Vocational 
Education (1977) provided an extensive system for creating rural 
school career guidance programs. Of equal significance, the 52 com- 
petency-based staff development modules developed at the American 
Institutes for Research (1976) filled a void.in career development train- 
ing for educators. 
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Sex Roles, ;Stereotyping, and Bias 



While researchers /nore openly recognize, since 1975 that previous 
'research In career development has been do/ninaj^d by the study of 
males and their occupational chd'ice and adjustment, the women^s 
movement has generated considerable interest in how gender affects 
career development. Both forces contributed" a wealth of research 
addressing the topic. 

Tibbetts (1975) reported that children still rigidly hold sex-stereo- 
typed attrtudes about work roles and Shinar (1975) indicated that occu- 
pations are clearly sex stereotyped by both males and females. On a 
similar not?, Peterson and Peterson (1975) indicated that child care is 
more the mother's than the father's responsibility. In addition, the 
notion that worpen exhibit a "fear of success " received new confirma- 
tion by Barnett's (1975) investigation which further implies that wOmen 
learn to avoid aspiration to high prestige occupations. McLure and Piel 
(1978) more specifically isolate the major reasons why women refrain 
from choosing careers in science and technology. 

Crawford (1978) found a connection between feminine role percep- 
tion and vocational choice in females as Ridgeway (1978) provided con- 
tmuing support that the career orientation among mother-identified 
women was associated with more extensive maternal employment, 
less conventional sex role ideology in both_parents. antJ greater dis- 
similarity between perception of self and father. 

Oliver (1975) and Sorensen and Winters (1975) found fathers played 
a more impactful role on the level of career commitment of women. 
Sedney and Turner (1975) proposed that a woman's high achievement 
need may lead to career orientation and decreased heterosexual orien- 
tation rather than a failure to develop heterosexual associations lead- 
ing to high need achievement. In studying female college students, 
Hall (1975) concluded that life stage is more important in determining 
role processes than chronological age while Richardson (1975) found 
that women who see themselves as homemakers are not career oriented. 

Additionally. Stake (1979) suggested the detrimental effects of low 
levels of confidence^in women's ability to resolve the home-career con- 
flict and Terborg (1977) assessed women's self-perception to be a re- 
strictive force in management positions. Goldman and Hewitt (1976) 
found women's career opportunities restricted by a weakness in mathe- 
matics-related abilities. 

Arvey and Gross (1977) and Gross and Arvey (1977) found home- 
makers' level of satisfaction with their work role correlated with the 
autonomous aspects of the job, the degree to which husbands assumed 
responsibility for homemaker tasks, and husbands' attitudes toward 
women in general. While the number of children did not have impact 
on satisfaction, the lack of recognition and supervisory opportunities 
proved least satisfying. Data from a national opinion survey found 
women's job satisfaction related to life satisfaction, age, and impor- 
tance of job income but did not relate to race, educational level, occu- 
pational prestige, income level, and attitude toward women working 
(Sell. Brief & Aldag, 1979). Peterson and Peterson (1975) reported that 
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the notion that women might earn more money than their husbands m 
their work g^i/^ed greater acceptance than heretofore. 

Lunnet)org (1^78) cited three stodtes where no sex differences were 
found in career decision-making styles. However, Gackenback (1978) 
found that both black and white women are more lilDeral in their sex role 
attitudes in t'he home and work environment than black and white men. 
yet black women are more traditional than white women m sex role 
attitudes in fhe home. ' " - , 

Restriction in career alternatives results from sex role stereotyping, 
according to the findings of Burlin (1976). Greenhaus and Simon (1976). 
Lunneborg (1976). and Osipow (1 976).Jnvestigating the extent to wlaich 
counselors attitudes reflected stereotypes. Ahrons (1976) and Medvene 
and Collins (1976) found that public school counselors, psychothera- 
pists and advanced graduate students all had restrictive attitudes Don- 
ahue and Costar (1977) found bias toward girls most pronounced in 
older female/School counselors and least restrictive among counselors 
working in cities of less than 25.000 population. Englehard, Jones, and 
Stiggins (197^, however, produced evidence indicating that sex role 
stereotyping by counselors was declining and Dipboye and Wiley 
(1977) found that recruif&rs rated identical resumes higher for females 
than for males. * o i 

Sex bias in interest measurement v^as of major concern to Peoples 
(1975) and was significantly monitored by the AMEG Commission on 
Sex Bias m Measurement (1977) which reviewed changes within 11 
popular interest inventories. The Strong-Campbell Interest Inventory 
(SCI!) the Strong Vocational Interest Blank (SVIB) and the SDS at- 
tracted most of the research attention. Within the SCII. Creaser and 
Carsello (1976) and Johnson (1977)* concluded that only same sex - 
scores should be interpreted. Further study by Campbell (1976) and 
Hansen (1976) indicated a need for additional scaling approaches to 
resolve the problem of sex differences in the S€ll. Holland (1 976) argued 
against the sex bias which Predigerand Hanson (1976a, 1976b) claimed 
existed within the SDS. During this tim,e Rayman (1976) and Hanson and 
Rayman (1976) demonstrated through the Unisex Interest Inventory 
(UNI-II) and the American College Testing Interest Inventory (ACT II) that 
interest measurement could be based on sex-balanced items 

Project Born Free was developed by Hansen and Krierleber (1978) as 
a staff-development system addressing .sex role stereotyping in career 
development. And while Yanico (1978) found empincal evidence of 
language s effect on sex bias. .Knell' and Winer (1979) garnered little 
support that well-established stereotypes could be counteracted by 
reading matenals. Additionally. O'Bryant and Corder-Bolz (1978) «ntii-' 
Gated that television teaches children about jobs and wprk and what 
sex workers should be. 

One of the advantages of personal interactions mih a compute^ 
system on issues of career development is that the.inquirers1ea\te^ 
traces of their travels in the system as they proceed SIGI~(Sy&terri for 
Interactive Guidance and Instruction) is programmed so that inquirers 
go through a sequence of specifying and clarifying their values, the 
selection of occupations and the assessment of thQ correspondence 
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of each with their clarified values and career planning. Norris, Katz 
and Cha pman (1978) report a carefull y wo rked out st udy of the v al u i n 
processes exhibited by young adult males and females in their inter- 
actions with that system. The results indicate that sex differences still 
exist in the values and processes which males and females use in the 
system. In an interesting breakdown of these results, the section co- 
ed ttors also found that both males and females who are less traditional 
in their value choices are less hetprogeneous in their occupational 
choices than are those who hold more traditional value patterns. 

Reading the Adult Years and Special Populations Into Career Development Theory 

Research on career development has largely been concentrated in the 
childhood, adolescent and young adult periods over the past 30 years. 
Retirement emerged as an area of research concern m the mid 1950's 
and has continued to be of concern particularly as American citizens 
have proveb able to retire earlier than heretofore. However, in recent 
years, growing attention has been given to the middle third of life. This 
interest is underscored by Sheehy's (1976) popular book Passages. 
That book draws heavily on the work of -Gould (1978) and uses the work 
of Levmson (1978) as well. These latter two books represent thorough 
treatises on the developmental phenomena of the later life. They both 
have evidence indicating that development takes place and exists be- 
yond college, the interval at which we traditionally have expected the 
personality to become set and subsequently to remain unmodified 
either personally or eventfully. Passages proves interesting but less 
helpful in potentially organizing the developmental phenomena of 
the adult years*. 

Since 1975, Crites (1976) supported developmental adult stages. 
Heath (1976) proposed further examination of personality dimensions 
in adults, and Murphy and Burck (1976) suggested the addition of a 
midlife career stage for men within Super's (1957) framework. 

In studying adult workers. Fry (1976) found an increase in submissive 
attitudes towards authority in men moving from school to job. Klem- 
berg (1976) found high occupational stability within Roe^s fields when 
comparing adolescents' characteristics and their work adjustments as 
adults. McLaughlin and Tiedeman (1974) found similar results as can 
be seen in their paper in tWe next section. Waterman and Waterman 
(1 976), in a study of vocational identity, found small portions of men who 
could be classified as "identity achievers." 

Interest in the career development of the mature adult expanded as 
Eden and Jacobson (1976) found resistance to retirement most preva- 
lent among older executives who felt young, healthy, and effective on 
the job. Wexley, McLaughlin, and Sterns (1975) examined retirement 
at various points and found significant changes in psychological need 
levels. 

A number of studies looked at career indecision. These resulted in 
the development of Osipow, Carney and Barak's (1976) Scale for Voca- 
tional Indecision. Hawkins. Bradley, and White (1977), McGowan (1977), 
Greenhaus and Simon (1977), and Barrett and Tinsley (1977a) all found 
variables related to indecision. Holland and Holland (1977) found evi- 
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dence for classifying several subtypes of undecided individuals 

Attempts to research mid-career change_and the role of leisure in 
c^eer development have gamed impetus since 197^ Wiener and 
Vaitenas (1977) identified traits less frequently characteristic of those 
who were classified as mid-career changers, and Fredrickson. Macy 
and Vickers (1978) reported results from 200 adults making career 
changes. The editor of the Vocational Guidance Quarterly acknowl- 
edged the growing interest in the middle third of Jife by dedicating the 
June 1977 volume to mid-life career change. The use of leisure to meet 
achievement needs was studied by Adams and Stone (1977) and Lon- 
don. Crandall, and Seals (19/7) examined its effect^on quality of life 
while Nuelmger s The Psychology of Leisure (1974), Helped to broaden 
the researcher's notion of career. 

Researchers seldom have ad.dressed career development of special 
populations in theory or research. However, Picou and Campbell (1975) 
made significant gams m this area by cqm piling career findings related 
to special groups. Also, Atlas (1978) recently demonstrated the career 
planning needs of unemployed minority persons and Dixon-Altenor 
and Altenor (1977)/ and June and Pringle (1977) demonstrated the 
need for consideration of factors impacting on the development of 
blacks Of particu/ar note is the fact that the Native American Career 
education Program (1977) includes career education units for native 
Americans. / 
Mieasurement and Assessment 

A good deal of ihe career development research published since 1975 
IS devoted to the assessment and measurement of career interests, 
abilities, occupational choice, career matunty,-^career decispn making 
and self-estimates. 

While Barrett and Tinsley (1977b) developed the Vocational Rating 
Scale which provides an assessment of awareness to specific voca- 
tional concepts, the more generally oriented Career Maturity Inventory 
4CMI) andahe~Career-„Da\^iopraealJavanlory„(CDJjL,cm^ 
popular research instrume'nts of vocational development Through the 
CMI, Omvig and Thomas (1977) concluded that a sex differential in 
career maturity should be expected between sixth and eighth grade 
students Using the CMI and the CDI, Yen and Healy (1977) demon- 
strated that paid employment among junior college students increased 
career maturity while Katz, Norris and Pears (1977) developed an ex- 
tensive career decision making exercise to directly measure compe- 
tence in the process of career decision making. However, as Jepsen 
(1975) found support for certain measures of career maturity in high 
school students, Smith (1976) and Dillard (1976) suggested caution in 
using the CMI with lower class and/or minority persons, and LoCascio, 
Nesselroth and Thomas (1976) made similar comments about the CDI 
Once again a positive correlation between career maturity and intelli- 
gence was confirmed by Lawrence and Brown's (1976) investigation 
In the recent past, investigations of interests continued to generate 
research possibilities. Grimm and Nachmias (1977) found that diver- 
gent thinkers held a wider range of interests than anxious subjects 
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who were more affected by the prestige value of future occupations 
Studies by Norton and Walsh (1976), Fishburne and Walsh (1976) and 
O Bnen and Walsh (1976) provided stringent tests of the validity of the 
Vocational Preference Inventory (VPI) and the SDS and added some 
support to Holland's (1959) hypothesis that people seek needs satisfy- 
ing environments while Villwock^Schnitzen and Carbonari (1976) found 
modest support for the notion that stability of vocational choice can 
be predicted. Bobele., Alston, Wakefield, and Doughtie (1976) and Al- 
ston and Wakefield (1976) found modest support for Holland's (1959) 
hexagon model while Smart (1976) found centering evidence, ^ 

Miller-Tiedeman (1976) developed the Individual Career Exploration 
(ICE) which IS modeled upon the SDS structure but uses the Roe (1956) 
occupational categories rather than the Holland (1959) categories on 
which the SDSjs based. Miller-Tiedeman (1977) later provided a pic- 
ture form of the ICE for use with persons of low English reading ability 

Support for the usefulness of personality scores as predictors of 
vocational persistence was sustained by Scott and Sedlacek (1975) 
and Holland and Nafziger (1975) reported positive correlations of the 
SDS with the Kuder Preference Record, the Bennett Mechanical Com- 
prehension Test..tj:ie Minnesota Paper Form Board, and the Thurstone 
Temperament Schedule. Further research by Holland, Takai, Gottfred- 
son, .and Hanau (1978) con&luded that the SDS achieved its effects 
becalise of the numerous options it offers. 

The Strong-Campbell Interest Inventory (SCII) also attracted exten- 
^ve study as Slaney (1 978) found support for incorporating the Holland 
themes and the SCII basic interest categories into the Vocational Card 
Sort (VCS). Lunneborg (1977) concluded that the SCII had excellent 
^ construct validity while Fabry, Blake, and Seran (1977) demonstrated 
^ validity between the General Occupational Theme scales and the scales 
of the American College Testing Interest Inventory in high school 
students. 

The Kuder Occupational Interest Survey was found by Zytowski (1976) 
to have greater significance for predicting college majors than occu- 
pations and tended to have greatest validity for persons who gttend 
college, or enter high-level scientific or technical occupations Tittle 
^and Denker (1977) found that the Kuder Occupational Interest Survey 
(KOIS) provided good differentiation of interests for older women re- 
entering the^abor market while Zytowski and Laing (1978) concluded 
that rankings on other-gender scales provided reasonably accurate 
estimates of expected rankings on unavailable own-gender scales 

Once again, as in previous studies, expressed interests indicated 
greater predictive validity than inventoried interests according to 
Borgen and Seling (1978) and Fabry and Poggio (1977). Expressed 
vocational Choidjfes of high school students proved to be more predic- 
tive of future employment status than the VPI or the Kujjer Preference 
Record according to Wiggins and Weslander (1977). Becker (1977) 
found students expressing the selection of a vocation and the intention 
of att^ending college to be more characteristic of students whose ex- 
pressed and inventoried interests were congruent. However, Hodgson 
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and Cramer (1977) found self-estimates of ability required by the SDS ^ 
potentially lead to unrealistic decisions. 

In comparing Holland's (1959) and Roe's (^956) classification sys- 
tems. Meir and Ben-Yehuda (1976) found conflicting support but West- 
brook and Molla (1976) found a high degree of similarity. Using Project 
TALENT data, McLaughlin and Tiedeman (1974) found career stability 
to be consistent through the Flanagan, Holland, and Rpe occupational 
/^classification systems. This study is reported in full in the next section. 

^ TOSSING PROMISING PEBBLES INTO THE CURRENTLY CALM POND 
OF CAREER DEVELOPMENT RESEARCH 

We have emphasized that ^ deep structure of theory in career "develop- 
ment, particularly of the career de.velopmerlt of males, has formed over 
the past 30 years. That deep structure presently determines the nature 
of the career development research now being reported. Our revlew'of 
career development research reported in the past five years has just 
underscored the present undisturbed nature of that deep structure. 
Practically none of the research published during the past five years 
has had much influence on the deep structure of that theory. 

In general, a single research study shouldn't be expected to create 
a scientific revolution overnight. However, in thfs section we look more 
closely at what we consider to be several promising studies amonj the 
recent additions to research in career development so that we can 
evaluate their potential effects more fully than we have done with the 
majority of studies reviewed in the preceding section. 
'Those studies which hold high potential for modifying research in 
career development are as follows. 

Overview (of the cross sectional study of early career development as 
revealed by the National Assessment of Educational Progress) by 
David V. Tiedeman, Martin R. Katz, Anna Miller^Tiedeman, and Samuel 
H. Osipow. 

Eleven-year stability and change as reflected in Project TALENT data 
through the Flanagan, Holland, and Roe occupational classification 
systems by Donald H. McLaughlin and David V Tiedeman. 

A social learning theory of career selection by John D. Krumboltz, Anita 
Mitchell, and G. Brian Jones. 

Causal inference among variables related to career decision making 
the chicken or the egg by Richard A. Kass, John p. Morefand, Vincent 
A. Harren and Howard E. A. Tinsley. 

The above studies offer a diverse view of current research in career 
development Two of the studies are based on probability samplings 
of the national population on which each is based. These studies in- 
clude that based on the National Assessment of Educational Prpgress 
(NAEP) and that based on Project TALENT In addition, the NAEP study 
illustrates what can be done about inferring developmental career 
effects' from item sampling results on a national basis into an age and 
concept framework. The Project TALENT study offers one of the more 
exact available comparisons of the relative effectiveness of the Flana- 
gan, Holland and Roe occupational classification systems. 
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The article on social learning theory is included td illustrate some of 
^ the more exacting statements of theory in career development which 
' are entering the literature now that we are 25 to 30 years beyond the 
initial formulations which created an earlier revolution in the study of 
career. Current theory changes the study of career from the study of 
singular vocational events in life to the study ot sets of occupational 
events in life. The chicken or the egg article illustrates some of the 
newer techniques which are being brought to bear upon older prob- 
lems in career development theory. For instance, Super's formulations 
of theory in career development largely depend upon the assumption 
that, career development evolves in the formation and crystallization 
of the self concept. Tiedeman and his colleagoes, on the other hand, 
argue extensively for a more open system, one in which persons (1) pro- 
gress through stages of development in ci cyclic fashion, and. (2) by 
making the process ever more conscious, succeed in developing some 
mastery over making their careers happen rather than just letting them 
happen. The chicken or the egg paper throws some light on this dis- 
tinction. 

As you read the four articles which follow, think about their (1) topic 
or focus, (2) purpose, (3) method, (4) findings, and (5) implications for 
career development theory. In this way you will grow in your capacity 
to engage in the function of learning so that you can hierarchically 
restructure your understanding of career d^velgDment theory. 
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THE ASSESSMENT 

Natiohcil Assessment of Educational 
Progress (NAEP) was initiated in 1964 
in response to need tor a record of 
the outputs as well as the inputs of 
education. The project goals incJIude 
collecting and reporting of informa- 
tion about specific educational 
achievements of young people in the 
United States, detecting and report- 
ing o^ changes in that achievement, 
conducting of special studies into 
selected areas of educational achieve- 
ment, and encouraging policy appli- 
cations of the new data. 

NAEP surveys the educational at- 
tainments of four milestone age 
groups. «ines, thirteens, seventeens 
and adults (ages 26-35). Nines have 
been exposed to the basic program 
of fSrimary education, thirteens have 
finished -their elementary school pro- 
gram, and seventeens are completing 
the high school progranrvr'Seventeens 
also incl^ude a sample of o^ut-of- 
school youth. Adults represent a 
group who^ave completed their for- 
rpal education and have been away 
from -school for a number of years. 



Ten educational areas are assessed 
in five year cycles. These are: art, 
career and occupational development, 
citizenship, literature, mathematics, 
music; reading, scieitee, social studies 
and writing. Each five-year cycle in- 
cludes the following steps: develop- 
ment and review of objectives by sub- 
ject rrjatter specialists and educators, 
development and field testing of exer- 
cises -to measure the objectives, ad- 
ministration of exercises to riational 
samples at the four age levels, and 
data analysis and interpretation. 

THE OBJECTIVES 

The survey of career and occupational 
development (COD) objectives which 
was administered during the 1973-74 
school year used exercises to measure 
ttie following objectives and sub- 
objectives: 

1. Prepare for making career deci- 
sions 

A Know own characteristics rele- 
vant to career decisions 

B^Know the characteristics and 
'requirements of different ca- 
reers and occupations 

C. Relate own personal charac- 
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teristics to occupational re- 
quirements 
D Plan for career development 
^ or change 
"? improve career ctrrtf occupational 

capabilities 
3. Possess skills that are generally 
useful in the world of work 
A Have generally useful numeri- 
cal skills 

B. Have generally useful commu- 
nication skills 

C. Have generally useful manual- 
perceptual skills 

D Have generally useful informa- 
tion-processing and decision- 
making skills 

E. Have generally useful interper- 
sonal skills 

F. Have employment seeking skills 
4 Practice effective work habits 

A. Assume responsibility for own 
behavior 

B. Plan work 

C. Use initiative and ingenuity to 
fulfill responsibilities 

D. Adapt to varied conditions 

E. N/talntain good health and 
grooming 

5- Have positive attitudes toward work 
A Recognize the bases of various 

attitudes toward work 
B Hold competence and excel- 
lence in high regard 
C. Seek personal fulfillment 

through own achievement 
D Value work in terms of societal 
goals tr 
This IS the total range of objectives 
used in the COD assessment Not all 
sub-objectives were assessed for 
each age level. In addition, the re- 
leased exercises interpreted here 
failed to include any items from sub- 
sections 4.B, 4.D. 4.E, or 5B Each 
.publication in this publication series 
describes the specific sub-objectives 
assessed as necessa'ry. 

THE EXERCISES 

The development of the COD objec- 
tives and exercises was completed by 
the Amencan Institutes for Research 
under contract with NAEP. The exer- 



cises were extensively reviewed and 
tested prior to the actual assessment, 
and were developed in consultation 
with educators, subject specialists 
anct lay pt^ r bu ii b Th^ e xercise s a rcra — 
unique aspect of NAEP. In addition 
to multiple choice items. NAEP uses 
other exercise formats such as open- 
ended questions and individual per- 
formance items- 

In any NAEP assessment, one-half 
of the exercises are released to the 
public while one-half remain unre- 
leased so that they can be used again 
in future assessments. This series re- 
ports only the results for the released 
career and occupational development 
exercises. Individuals who are inter- 
ested in using the released exercises 
locally can obtain copies of the ex- 
ercises and their scoring instructions 
by ordenng the Career and Occt/pa- 
' tional Development Technical Report: 
Exercise Volume from. National As- 
sessment of Educational Progress 
Education Commission of the States, 
1860 Lincoln Street Suite 700. Denver. 
Colorado 80203. 

THE SURVEY 

NAEP administers exercises to na- 
tional samples at each age level. Ex- 

. ercises are administered in packages 
which contain several exercises and* 
which can be administered in a rea- 
sonable time period Packages are 
administered to a national sample 
which IS stratified by region of the. 
country, size of the community and 
socioeconomic level. About 100,000 
respondents were sampled in the 
1973-74 Survey of Career and Occu- 
pational Development. However, not 
all respondents took alt exercises. 

' For example, more than 35,000 Tiiir- 
teens participated in tfiq assessment 
but only 2,200-2,700 Ttiirteens re- 
sponded to any one of the exercise 
packages. The total number of re- 
spondents included in each age group 
was as follows: Nines ~ 28;281 : Thlr- 
teenS — 38,289; Seyenteens (In school) 

— 34,211; seventeens (out of school) 

— 994; and Adults— 2,138. • 
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THE DATA 

The Career and Occupational Devel- 
opment Survey is an objective-refer- 
enced assessment This means that 



the resultjs are reported ^ percent- 
ages of the total group or specific 
sub-group which gave acceptable or 
otherwise categorized responses for 
a specific exercise related to a spe- 
cific career and occupational devel- 
opment objective. No attempt is made 
to summarize overall performance for 
individuals Objective-referenced re- 
sults are helpful in providing insights 
into the current achievement levels 
of specific groups on each of the mea- 
sured objectives. 

The Early Career Development series 
reports P-values for various exercises. 
The P-values are weighted estimates 
of the total population percentages. 
Thus, f3r example, a statement that, 
"90% of Nines gave an acceptable 
response. " means that 90% is an esti- 
mate of all the Nines in the United 
States who would have given an ac- 
ceptable response if the total popula- 
tion had been assessed. 

THE EARLY CAREER DEVELOPMENT 
RESULTS 

Figure 1 offers a condensed cross- 
sectional depiction of early career 
development as revealed by the 1973- 
74 National Assessment of Educa- 
tional Progress As indicated in the 
footnote to Figure 1, A denotes career 
and occupational behavior which is 
relatively absent m the age group 
Quantitatively the letter A is used 
when the national incidence was zero 

» percent or greater but less than 25 
percent A letter B reports that a 
behavior is moderately present, it 

^ being expected in 25 or greater per- 
cent of an age group but not as many 
as 50 percent of the age group A 
letter C reports that a behavior has 
started to become reasonably en- 
trenched, its incidence being in 50 
percent or more of the age group in 
the nation but not as many as 75 per- 
cent of the group. A letter D indi- 
cates that a behavior has become 



fairly universal m the age group, it 
having appeared in 75 or more of 
the group. A letter X indicates that the 
exercise was not administered to the 
-a§6--§mtip-^rv--the-strbsequ^n{%rter-- 



pretations of Figure 1, the t6rms. 
"relatively absent," 'moderately pres- 
ent," "reasonably entrenched," and 
"relatively universal" denote each of 
these ranges respectively Although 
an incidence of 51 percent in an age 
group qualifies as 'reasonably en- 
trenched" by definition, the reader 
might well question the depth of 
the behavior's entrenchment when it 
exists in only slightly more than a 
majority of an age group as later 
reported exactly in the repiamder of 
this report An overview without full 
detail exacts such a price in meaning 

The reader is due another note of 
caution before turning to the results 
In fewer than 5 percent of the reports 
in Figure 1, percents close to bound- 
aries were depicted in the same 
category as an adjoining age group 
tn order not to suggest developmental 
change when age group differences 
were very small. For instance, an 
incidence of 47 percent among'nines 
and 50 percent among thirteens will 
probably be recorded as two letter 
B's rather than as a letter B for the 
nines and a letter C for the thirteens 
This conservative convention mini- 
mizes the developmental changes to 
which your attention will be drawn 
Complete results are reported is sub- 
sequent chapters. 

Finally, the specific questions are 
condensed in Figure 1 to provide 
meaningful impressions. Each ques- 
tion IS explained in greater detail in 
subsequent chapters 
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^ - FIGURE 1 

A Condensed Cross-Sectional Depiction of Early Career Development 



In this figure, A indicates an incidence of 0-24% for the age group B indicates an inci- 
dence Of 25-49% for the age group C indicates an incidence of 50-74% for the age 
group. D indicates an incidence of 75-100% for the age group X indicates that the exer- 
cise was not taken by the age group ^ 



PREPARE FOR MAKING CAREER DECISIONS 
A. Know Own Characteristics Relev^t to Career De- 
cisions 

1. Talked seriously to someone about career plans'^ 
{101 002) 

a. Yes 

b. Who was consulted first? 

1) Peers , 

2) Parents 

3) School counselor 

4) Other counselor 

c Person consulted was older 

d. Person consulted was aware of abilities 

e. Who was consulted at least once? 

1) Peer 

2) Parents* 

3) Counselor 

4) Teacher 

5) Other adult 

2 Have you ever taken an aptitude test'' (101 Oil) 

a. Yes \ 

b. Discussed with an advisor*? (includes coun- 
selor) 

B. Know the Characteristics and Requirements of Dif- 
ferent Careers and Occupations 
1. Identify each of five common occupations (i.e. 
nurse,^ mallcarrier. secretary, service station at- 
tendant, newscaster) from functional descrip- 
tions (102 002) 

2 Name a job from a brief description (102 Oil) 
a Machinist 

b. Architect " 
c Teller 
d Locksmith 
e. Baker 

3 Answer specific questipns' about specific jobs 
(102 013) 

' a Each of 8 jobs (i e. auto repairman, secretary, 
accountant, chemist, carpenter, social worker, 
watch repairman, secretary) 
b X-ray technician 
4, Knowledge of length of training required by at 
least four\>f five jobs (102 018) 
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5. Correctly identifies earnings of at least 3 of 4 jobs 
(t02 031 ) . . 

6. Main reasons a job promotion would be accepted 
(102 023) . 

a. Personal satisfaction 

b. Challenging 

c. Working conditions 

d. Status and prestige 

7- Main reasons a job promotion would be refused 
(102 023) 

a. Dislikes working conditions 

b. Doesn't deserve it 

c. Interpersonal reasons 

d. Doesn't like new job 

e Too much responsibility 

C. Relate Own Characteristics to Occupational Re- 
quirements 

1 Translating current interests into job require- 
ments (103 002) 

a. Believe they have such interests 

b. What. IS if^ 

1) Each of games, individual sports, musical 
or artistic abilities, hobbies and crafts, 
school or academic areas, household skills 

2) Group sports 

c. For what job is it useful? 

1) Related or teaching it 

2) Professional doing same thing 

d. How useful? 

1) Knowledge or experience in field 

2) Interest can help in the'job 
2. If looking for a job: (103 003) 

a. Can name two job-related skills they have 

b. Can name two job-related skills they lack 

c. Either of which is a specific skill/ability. 

D. Plan for Career Development or Change 

1 Have at least one school subject useful' for a job^ 
(104 003) 

a. Yes 

b. What subject*? 

1) Each of science, English, the arts, social 
science, physical education, foreign lan- 
guage, industnal arts, home economises, 
vocational education 

2) * Business education 

3) Mathematics 
c For what job*? 

1) Professional in field named 

2) Teacher of field named 

3) At least vaguely related 
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2. List 10 things to consider in choosing a' job or 
career (104 009) 

a. How many? 

1) All 10 acceptable 

2) At least 5 acceptable 

b. What kind? 

1) Each of ethical considerations, possible 
discrimination, responsibilities, duties 

2) Each of job availability, status, interper- 
sonal relations 

3) Each of job qualifications, personal abilities 

4) Personal satisfaction 

5) Working conditions 

3. Name 5 things to do now to find out more about 
a job you are interested in (104 Oil) 

a. How 'many*? 

1) At least one acceptable 

2) All 5 acceptable 

b. How? 

1) Each of from schoolteacher 

2) Counselor 

31 Each of reading or'contacting employer 
4)1 People of field 

4. With regard to a job you would like to have in the 
future (104 015) 

a. Have thought about it 

b. Name up to 5 considered 

1) AM 5 

2) At Ieasy3 

3) At least 1 

c. Occupational cafegory in which not inter- 
ested'? 

1) Each of 16 specific categories 

2) Professional 

d. Name 3 things would like about job 

1) How many 

a) All three 

b) At least one 

2) What kind? 

a) Each of responsibility, prestige, job 
availability, job qualifications, personal 
abilities 

b) Helping people 

c) Each of mechanical aspects, interper- 
sonal relations 

d) Duties 

e Name 3 things would not like 
* 1) How many? 



a) All three 

b) At least one 
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2) What kind? 

a) Each of responsibility, helping people, 
prestige, job availability, job quaUfica- 

^ tlons, personal abilities, interpersonal 
relations 

b) Each of duties, mechanical aspects 

f. Name 3 skills needed to do your desired job 
1) All three 

2f At least 1 

g. Three jobs using same skills/abilittes 

1) All three 

2) At least 1 ^ 

5. Employment experience and desires (104 016) 

a. Now working full time 

b. Things liked about a job 

1) Each of 31 things 

2) Each of working conditions, pay. Interper- 
sonal relations 

c. l^iings disliked about a job 
rj^ach of 37 things 

2) TOrking conditions 

d. Something in work gave a senae of satisfaction 

1) Yes 

2) Each of 34 things 

3) Ability to produce a quality product 
IMPROVE CAREER AND OCCUPATIONAL CAPA- 
BILITIES 

A. Work Is done to help out at home (200 002) 

B. Kinds of sites visited (200 018) 
' 1. Newspaper plant 

2. Dairy, college, planetarium 

3. Factory, aquarium 

4. Farm, zoo, museum, airport, library 

C. Lessons, training, or courses taken outside of regu- 
lar school (200 016)- 

1. Each of school or academic areas, an organiza- 
tion, group sports 

2. Each of individual sports, the arts 

D. Activities done without help (200 019) 
1. Personal and family living activities 

a. Care of persons 

1) Taken own temperature 

2) Baby sat ^ 

b. Home making 

1) Ironed clothes 

2) Each of changed sheets, washed dishes, 
washed windows 

c. Cooking — each of baked cake, cooked com- 
plete meal 

d. Sewing 

1) Made clothes for self 

2) Knit . y 

e. Gardening 
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Age 

9__ta-JLL. A_ 

2. Communicative activities ^ 

a: Ordered from a catalogue B B -X X 

b. Each of Chopped, used^ibrary, card catalogue, 

written a report C D X X 

c. Written a letter D D X X 

3. Technological activities 

a. Maintenance 

1) Drawn a map B D X X 

2) Each of painted gn object, put batteries In / 
a flashlight D D X X 

b. Construction 

1) Each of built or carved something of wood, 

made a toy C C X X 

2) Set the time on a clock D D X X 

c. Innovation 

1) Each of inverlting a game, designing some- 
thing to make C C X X 
POSSESS SKILLS THAT ARE GENERALLY USEFUL 
IN THf WORLD Qf WORK . 

A. Have Generally Useful Numerical Skills 

1. Reasoning with numerical data presented in a 
display 

a. Reading table of shoe sizes (301 019) 

b. Reading a bar graph (301 005) — all three 
readings 

c. Reading a floor plan (301 010) — all three 
readings 

2. Conversion from one scale to another 

a. Identifying which of four fractions exceeds a 
stated decimal (301 Oil) 

b. Conversions of minutes and seconds (301 033, 
301 0^4^ 

1) Minutes to seconds 

2) Seconds to minutes 

c. Conversion of feet to inches (301 034, 301 014) 

1) Feet to inches 

2) Inches to feet 

d. Conversions of pounds and ounces (301 035, 
301 014) 

1) Ounces to pounds 

2) Pounds to ounces 

e. Six correct conversions in b, c, & d 
3/Calculating 

a. Calculating amount of finance charge paid in 
a two-year period (301 032) 

B. Have Generally Useful Communication Skills 

1 . Follow 3 street directions (302 010) 

2. Find telephone number from book within five 
minutes (302 020) 

a. Within first minute 

b. Within five minutes 



X 


C 


D 


D 


X 


B 


B 


B 


X 


A 


B 


B 


X 


C 


D 


C 


c 


D 


D 


D 


A 


B 


C 


C 


C 


D 


D 


D 


A 


B 


C 


C 


B 


D 


D 


D 


A 


C 


D 


D 


X 


A 


C* 


C 


X 


A 


B 


C 


B 


D 


D 


D 


A. 


B 


^ C 


D 


B 


D 


"D 


P 



ERIC 



220 



230 



9 


13 


17 


A 


B 


D 


X 


X 


X 


C 


D 


D 


X 


X 


B 


B 


X 


X 


C 


B 


X 


X 


D 


C 


X 


X 


B 


B 



Age 

9 ' 

3. Addressing an envelope (302 015) — all six parts 
correct 

4. Fill out an order blank (302 005)— all six parts 
correct 

5. Discussion activities with organized groups 
within last 12 months (302 017) 

a. Lead 

b. Sp9ke or reported 

c. Participated 

d. All three 

C. Have Generally Useful Manual-Perceptual Skills 

1. Read quantity of liquid depicted in a measuring 

cup (303 Oil) B D D D 

2. Determine lenght of a 3% inch line (303 008) B C D D 

3. Sketching four objects in three dimensions (303 
012) 

a. Position, 3-dimensionality and size X A A A 

b. Relative sizes - X A A A 

c. Position X B B A 

d. 3-dimensionaMty X C C C 

D. Have Generally Useful^ Information-Processing and 
DecisJon-Making Skills 

1. With respect to airlines limiting hiring of stew- 
ardesses to unmarried women between ages of 
21 and 35 (304 001) 

a. RecommencJs at least some liberalization of 

policy re sex X X A A 

b. Recommends at least^spme liberalization of 

policy re age ^ X X B B 

c. RecommendsJn least some liberalization ot 

' policy re majMslige X X C C 

E. Have Generally Useful Interpersonal Skills 

1. Has helped another with school work (305 008) D D D X 

2. Offers at Jeast one constructive way to help some- 
one who speaks ^almost no English (305 009) D D D D 

3. After viewing a film showing a supervisor in ac- 
tion: (30'5 010) 

a. Identify four of following things as best things 
supervisor did: organize task, explained task, 
helped employees with the task, polite, ac- 
cepted suggestions, praised good work, uti- 
lized strong pcfints X C C X 

b. identify four opposites of things in (a) as four 

worst things supervisor did X C C X 

F. Have Employment-Seeking Skills 

1. List five acceptable kinds of part-time work peo- 
ple your age do to earn money in or near your 

town (306 006) X C C X 

2. In relation to gn advertisement: (306 009) 

a. Letters of< application were written for sales- 

, person ' X X B B 

b. Letters of application were written for appren- 
tice mechanic X X B B 
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X B B 



X X D D 

X X A A 
X X A B 



X A A 
X D D 



* c Letters of application were vyrltten for office 
helper 

d. In 'their letters, respondents formatted cor- 
' rectly 

1) Return address X X A A 

2) Date, inside address ^ ^ 5 S 

3) Greeting, closing, signature 
e In their letters, respondents correctly han 

died mentioning of: 

1) References, reason(s) for wanting job 

2) /lnterview 

3) 1 Contact X X B B 
f. Iniheir letters, respondents: 

1) Dfe«a4tf^ the job correctly ' X X D D 

2) Described their qualifications 

a) By including relevant personal qualities 

b) By correctly including their high Jevel 
qualifications 

IV, PRACTICE EFFECTIVE WORK HABITS 
A, >AssuA7?e Responsibility for O^n Behavior 

1. When going to the store to get bread for mother, 
Mary is stopped by Tom, they talk so long the 
stbi'e closes, and Mary returned without the bread 
(401 003) Fault was ascribed to 

a. Mary for talking too long 

b. Tom for talking too long or for not letting Mary 
leave 

c. No- one because Mary didn't want to be rude 

2. With respect to an Injury you inflict oh another 
while operating a factory machine without safetv 
shield In place as required, respondent: (401 001 

a. Accepts responsibility for accident 

b. Offers an acceptable reason for responsibility 

3. In trying to get an unfair rule changed, would do: 
(004 103) ^ 

a. Each of obey, talk it over with a peer or with 
sbmeone without authority, protest or peti- 
tion, enlist the aid of one's representative 

b. Discuss with someone in authority B B^ X X 
C. Use Initiative and Ingenuity to Fulfill Responsibilities 

1 Does each of three things correctly in folding 
and stapling two sheets of paper to conform to 
a model (403 004) 

2. Would ask question of a teacher if failed to under- 
stand what had to be completed tomorrow (403 
005) 

3. Correctly identifies one of four least worthwhile 
questions to ask a supervisor discussing a new 
rush manufacturing order (403 010) 

V, HAVE POSITIVE ATTITUDES TOWARD WORK 

' A. Recognize the Bases of Various Altitudes Toward 
Work 
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A A X^ X 
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1. Names each of the following as one of six rea- 
sons why people willing to work find It hard to get 
work. (501 009) age, race, sex, appearance, per- 
sonality/manners 

2. Can a person like a repetitive job? (501 Oil) 

a. Yes 

b. For each of the following reasons; likes it, likes 
pay, \tkes routine, likes associates, likes ma- 
terial used, likes mental aspects, satisfied if 
doing job well, only job could get 

C. Seek Personal Fulfillment Through Own Achieve- 
merits 

1. Believe that following should ^finally decide on 
the work one should do for a living (503 Oil) 
a. Each of parents or respondent and parents, 
persons other than parents or respondent 
and others 
*^b. Respondent alone 

2 If a millionaire, respondent would enjoy (503 012) 

a. Building houses or gardening ] 

b. Raising race horses 

c. Giving to charity 

d. Each of traveling, learning new things 
D Value Work in Terms of Societal Goals 

1. Child labor laws should be continued: (504 005) 

a. Yes 

b. For each of the following reasons: 

1) To protect children's physical and emo- 
tional well being, to let them gain educa- 
tion unencumbered by work, and becau^ 
they are not qualified to work 

2) Children easily exploited by parents and 
employers, and to allow more adults to be 
employed 
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PREPARE FOR MAKING CAREER 
DECISIONS 

A. Know Own Characteristics Relevant 
to Career Dectsions 

Talk about career plans becomes 
moderately e*ntrenched fn seventeens. 
As might be expected, parents are 
moderately likely to be the first con- 
sulted about career plans but are 
pretty generally consulted sometime. 
Counselors and peers are moderately 
likely to be consulted at least once 
but whoever ts consulted is pretty 
g^'enerally likely to be older than the 
respondent. 



Surprisingly, the incidence of hav- 
ing taken an aptitude test is only 
moderately present^^ong seven- 
teens and its discussioH with an ad- 
visor is practically noi Wxisteiy t Ut- 
doesn't appear that counselors un)i 
versally figure in Americans' caree^ 
'planning. 

B. Know the Characteristics and 
Requirements of Different 
Careers and Occupations 

Identification of common occup 
tjons is rather universal even amqfhg 
nines Identification of a job from a 
brief description tends to become 
more universal later than nine. There 



ts a gradient of untversality depending 
on the job. Bakers, locksmiths and 
tellers drd universally identified by 
seventeen, but architects and ma- 
chinists are less frequently identified 
even by adults. 

Except for x-ray technician, which 
IS never more than moderately asso- 
ciated with specific statements about^ 
it, thirteens, seventeens, and adults 
pretty universally a re able to answer 
specific questions about specific jobs 
which are in public awareness quite 
a bit. This knowledge even extends 
m less of the population and at a 
later time in development to knowl- 
edge of lengths of training and the 
specific earnings of many of these 
visible jobs. 

Only status and prestige along with 
heavy responsibility are moderately 
present as reasons why respondents 
would accept or refuse a job promo- 
tion respectively. It appears that even 
among seventeens and adults, there 
are no universal values which Ameri- 
cans follow in the pursuit of thdt elu- 
sive thing called job progress 

Surprisingly, there seems to be a 
fair anxount of occup^ational knowl- 
edge seeded among the American 
population. Although we must be 
selective in our application of this 
result, the result does suggest that 
some diminution of excessive doses 
of occupational information might be 
m order for some Americans 

C. Relate Own Characteristics 
to Occupational Requirements 

An important career skill is the ca- 
pacity to translate one's own char- 
acteristics into occupational require- 
ments so that each individual can find 
employment in which satisfaction and 
success coexist Despite numerous 
efforts to do this for persons, we still 
haven t found a foolproof means of 
doing so. Hence it is of interest to see 
the degree to which this skill is de- 
veloped. 

Notice that belief that one has an 
interest is fairly universally entrenched 
at thirteen. However, except for group 
sports which is moderately present 
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as an interest among thirteens, most 
of the interests named occur with 
slight incidence and are rather gen- 
eral to home and school activities 
In addition, the translation skill hasn't 
matured in many Americans even by 
seventeen. The translations of inter- 
ests to jobs are moderately present 
only with an association of being a 
professional in the same thing In 
which one is interested, and the rea- 
son why the interest can be useful is 
largely limited to indicating that it 
offers some relevant knowledge and 
experience in the field. With adults, 
these relational skills are moderately 
entrenched in terms of naming two 
job-related skillsjheyhave and dwin- 
dles to being only moderately pres- 
ent in the identification of two job- 
related skills they lack, either of 
which IS a specific skill or ability 

D. Plan for Career Development 
or Change 

A cursory glance at the released exer- 
cises of this sub-sectl0n should 
quickly point ^out the similarity of 
the skills assessed here to those as- 
sessed in the prior sub-section This 
time, however, the interest-to-possi- 
bility translation has been extended 
to the skills involved in planning for 
taking a job. Note that there are five 
questions dealing with (1) the trans- 
lation of school subjects into job 
possibilities. (2) the listing of factors 
of relevance to job choice. (3) indi- 
cating how to learn mlSre aboufjobs 
in which one is interested, (4) indi- 
cating how far one has gone in job 
planning, and (5) the status of first- 
hand job familiarity among seven- 
teens and adults. 

At thirteen and seventeen, respon- 
dents almost universally believe they 
have studied at least one school sub- 
ject which will be useful in a job 
The subject is business education 
which occurs with moderate inci- 
dence among seventeens and mathe- 
matics which occurs with the same 
moderate incidence among thirteens 
However, respondents at these ages 



can only vaguely relate their school 
subjects to job requirements 

Seventeens and adults can name 
ten things acceptable m the choice 
of a job wjth moderate incidence, and 
at least five universally Thirteens are 
a cafegory below these incidences in 
^ach instance Working conditions 
are almost universally nanaed at all 
three ages with personal satisfaction 
being reasonably entrenched 3S well 
The remaining things occur with less 
incidence 

Thirteens and seventeens aren't 
very likely to name five acceptable 
things they can do now to find out 
about a job in which they are inter- 
ested, but the capacity to name at 
least one acceptable thing is reason- 
ably entrenched m both age groups. 
Counselors are named as a source 
of such information in only moderate 
incidence among seventeens, while 
thirteens seldom identify counselors 
as an information source Fortunately, 
people in the field are reasonably en- 
trenched as an information source 
by seventeen. 

Thirteens and seventeens have fairly 
universally thought about a job they 
would like^to have in the future and 
can name at least one such job. How- 
ever, the capacity to name as many 
as five such jobs is practically absent 
m both age groups. Naming three jobs 
seems to be the extent of this capacity 
in a moderate proportion of thirteens 
and in a more entrenched proportion 
of seventeens. Professional jobs are 
reasonably likely to be included as 
one of the three jobs considered The 
remainder of exercise 4 indicates that 
job thinking has become slightly dif- 
ferentiated in moderate to entrenched 
proportions of thirteens and seven- 
teens in the United States. This dif- 
ferentiation extends to being able to 
name three things they would like 
about a considered job. as well' as^ 
three things they would not like. They 
can also reasonably frequently name 
three skills needed to do a desired 
job as well as three jobs which use 
the same skills or abilities. 



Finally, exercise 5 report^the em- 
ployment expenence and desires of 
seventeens and adults A moderate' 
proportion, of seventeens are work- 
ing full time but adults are almosj^ 
universaHy^working. A, sense of satf^^ 
faction with work was reasonably en-* 
trenched among seventeens and al- 
most universally pTeeent among 
adults. The specific things which 
seventeens and adults like and dis- 
like about a job or which gave^^yjem 
a sense of satisfaction from work 
were sp variable )hat the incidence 
of each one of them was practically . 
non-existent The most frequently 
mentioned 'ones were working condi- 
tions, pay, and interpersonal relations 
as liked in a job, working conditions 
as disliked in a job, and ability to 
produce a quality product as sonne- 
thing which gave a sense of satis- 
. faction at work. 

Summary 

The emerging picture so far. then,/ 
appears to be that Americans don'/ 
confer much^with counselors about 
career plans, do have a fair»am6unt 
of common occupational knowledge, 
but even as adults don't have well 
developed skills for translating who 
they are and vyhat they have done into 
what they might do This latter ob- 
servation needs tempering by realiza- 
tion that, with regard to job planning, 
at least by seventeen, Americans have 
developed a few capacities which help 
them translate their schoo+xexperi- 
ence into job platining The differen- 
tiated circumstances at this time are 
that a handful of jobs have been con- 
sidered and respondents know some 
means of getting further Information 
Finally. Amencans are pretty univer- 
sally at work as adults and report that , 
their work does give them a sense of 
satisfaction. Such an observation 
should make us wonder about how 
much career counseling children, 
adolescents, and young adults actu- 
ally need However, wheh only the 
very faint indications of differenti- 
ated career skills emerge as they do 
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in these NAEP data, they should really 
whet the appetites of those career 
counselors who seek to develop ca- 
reer relevant skills. These *data indi- 
cate the large amount of room left 
for fOrther education m translating 
interests into job possibilities and 
the further differentiation of job 
planning skills. 

IMPROVE CAREER AND 
OCCUPATIONAL CAPABILITIES 

Youths undertake numerous activi- 
ties which improve their career and 
occupational capabilities Almost uni- 
versally, nines, thirteens, and seven- 
teens report that they have worked 
around home to help out Nines and 
thirteens also almost universally visit 
farms, zoos, museums, airports, li- 
braries, factories, and aquaria al- 
though It IS a somewhat moot point 
about how much career skill and 
focus such visits have provided Only 
a small proportion of nines, thirteens, 
and seventeens have taken lessons, 
training, or courses outside of school 
except for individual sports and the 
arts which are taken by a moderate 
proportion of each age group Hence, 
even their direct learning activities 
still don't have too much significance 
for career skills and development. 
However, with regard to common ac- 
tivities done at and around home, the 
0ata suggest that most personal and 
family living, gardening, ccmDrriunica- 
tion. maintenance, construction, and 
inndvation activities are pretty well 
entrenched among nines and thir- 
teens. 

Chores, common activities, visits, 
and lessons abound among American 
youths These activities can form the 
basis of career skill and development 
if focused with such purposes in mind 
as they occur or relatively soon after- 
wards 



POSSESS SKILLS THAT ARE 
GENERALLY USEFUL IN THE WORLD 
OF WORK 

A. Have Generally Useful 
Numerical Skills 

Conversions of minutes to seconds, 
feet to inches, and ounces to pounds 
become and remain almost universal 
by thirteen. Conversions in the re- 
verse direction which ordinarily in- 
volve fractions and division only be- 
come entrenched by about seventeen 
and peVsist at^only this level with 
adults, Reading! tabfes of shoe sizes 
becomes almost universal by seven- 
teen, but reading bar graphs and 
floor plans remains no more than 
moderately present among, thirteens. 
seventeens and adults. Calculating 
the amount of a finance charge paid 
over a two year period progresses 
from being almost absent through 
moderately. present to reasonably 
firmly entrenched from thirteen to 
adult years. 

It appears, then, that generally use- 
ful numerical skills emerge ih the 
order of conversion from one to an- 
other metric, to reasoning with nu- 
merical data presented in a display, 
and on to simple Calculating, All 
these skills are reasonably well en- 
trenched among adults 

B. Have Generally Useful 
Communication Skills 

Following simple street directions, 
finding a telephone number in a book 
within five minutes, and addressing 
an envelope are generally useful 
communication skills which are al- 
most universally present in the United 
States population at thirteen How- 
ever, finding that number in the tele- 
phone book within only one minute 
doesn t become universal until adult 
age. 

Participation in discussion with or- 
ganized groups IS reasonably en- 
trenched by seventeen, as is speaking 
or reporting. However, leading a 
group is only moderately present in 
both seventeens and adults. 
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C. Have Gen^erally Useful 
Manual-Perceptual Skills 

JBeading the quantity of a liquid de- 
picted in a measuring cup is an al- 
most universal skill by thirteen. De- 
termining the length of a 3^ in'ch line 
IS firmly entrenched at thirteen but 
doesn t become almost universal 
until seventeen Representing the 
three dimensionality of a four-ob|ect 
model IS reasonably entrenched at 
thirteen as well and never becomes 
almost universal ai*nong adults Rep- 
resenting the position and relative 
sizes of the four objects is a less pro- 
portionately available skill, although 
position representation is moderately 
found among thirteens and seven- 
teens 

D. Have Generally Useful 
Information-Processing Slcills 

When confronted with a problem of 
recommending the liberalization of 
an airline hiring policy restricting the 
hiring of stewardesses to that of un- 
marned females between 21 and 35 
years of age, at least liberalization 
of the marriage restriction is reason- 
ably firmly entrenched among seven- 
teens and adults. However, liberal- 
ization of the age policy is to be 
found in only a moderate proportion 
of these age groups and liberaliza- 
tion of the sex limitation is practi- 
cally never recommended. It appears 
that seventeen-year old and adult 
Amencans like female stewardesses, 
would prefer them young but don't 
worry as much about whether they 
are married or not 

E. Have Generally Useful 
Interpersonal SIcills 

Persons in the United States seem 
almost universally to have helped 
another with school work from age 
nine on They also almost universally 
offer at least one constructive way to 
help sorr^^ne who speaks almost no 
English from that age on as well 
Finally, after viewfng a film showing 
a supervisor in action with workers, 
the capacities to identify four things 



which the supervisors did best and 
worst each are also reasonably en- 
trenched among thirteens and seven- 
teens It appears, then, that in these 
relatively simple interpersonal skills, 
most Americans have them from age 
thirteen on, 

F. Have Employment-Seelcing SIcills 

Knowledge of five kinds of part-time 
work which people at ages thirteen 
§nd seventeen do to earn money is 
reasonably entrenched in these age 
groups. In writing a letter applying 
for a job in response to an advertise- 
ment, seventeen-year old and adult 
respondents are about equally split 
among applying for the jobs of sales- 
person, apprentice mechanic, and 
office helper. The letters which they 
write are almost universally accu- 
rately formatted with regard to greet- 
ings, closing, and signature, but the 
date,, inside address, and return ad- 
. dress are done accurately in only 
moderate proportions or less of the 
age group The same proportions 
held with regard to substantive essen- 
tials.such as including names of per- 
sons from whom references could b^ 
obtained, asking for an interview, 
and indicating how the potential em- 
ployer might contact the applicant 
However, seventeens and adults do 
.almost universally mention their high 
level qualification as well as describe 
the job accurately Relevant personal 
qualities are practically never men- 
tioned. 

It appears, then, that Americans as 
young as thirteen know about nearby 
part-time job opportunities but that 
even seventeens and adults have dif- 
ficulty in applying for a job when it 
comes to including personal matenal 
and the meat and potatoe^f present- 
ing themselves in a job-getting light 

Summary 

Americans seem to possess a fair 
quantity of the simple skills which 
are generally useful in prepanng for 
the world of work, . 
Converting from one to another 



i 



metnc is reasonably entrenched by 
seventeen when the capacity to re- 
verse direction is also included. 
Reading tables and bar graphs has a 
similar incidence by a similar age. 
Simple calculating doesn't become 
reasonably firmly entrenched until 
adult life and then only when the 
skill remains one which continues 
to be of direct use m living after leav- 
ing school. 

Participating in discussions within 
groups IS also, reasonably entrenched 
by seventeen along with speaking and 
reporting, 

Reading the liquid levels in a gradu- 
ated container, measuring the length 
of a line and representing the three- 
dimensionaKty of a model are all rea- 
sonably entrenched by thirteen and 
ature further by seventeen. 
Seventeen-year old and adult Amerir 
cans like female stewardesses, would 
prefer them young but don't mind 
their being married. Elimination of 
sex and age discrimination resident 
in the policy of hiring airline stew- 
ardesses therefore doesn't seem to 
be an act that would meet with popu- 
lar appeaMn the United St9tes 

From age thirteen on, most Ameri- 
cans have rudimentary interpersonal 
skills such as knowing how to help 
another and knowing what work su- 
pervisors do well and poorly 

If the skills tested in the NAEP be 
likened to those of literacy, these data 
indicate that American adults are gen- 
erally literate with regard to simple 
numerical, communication, manual- 
perceptual, information-processing, 
interpersonal, and employment-seek- 
ing skills Incidences of these skills 
largely change after thirteen or seven- 
teen years of age. However, when the 
simplicity of the skills tested is 
gauged against the complexity of 
today s world, it appeals that simple 
career skill literacy is insufficient for 
daily life. These data suggest to coun- 
selors that, while work remains be- 
fore them in making simple career 
skill literacy universal, vistas lie be- 



fore them in facilitating the more com- 
plex self and career development 
skills which they favor. 

PRACTICE EFFECTIVE WORK HABITS 

A. Assume Responsibility for 
Own Behavior 

The most basic career skill is a fully 
developed capacity to differentiate 
what one causes in one's environ- 
ment and to take appropriate respon- 
sibility for that which one does cause 
The NAEP data indicate that less than 
50 percent of nines and thirteens take 
responsibility for what they cause or 
would take very effective steps to get 
an unfair rule changed. On the other 
hand, seventeens and adults almost 
universally say they would assume 
responsibility for an accident they 
caused at work which injured an- 
other. It appears, then, that there 
may be a break m the capacity to dif- 
ferentiate and own what one causes 
which occurs between thirteen and 
seventeen, 

B. Use Initiative and Ingenuity 
to Fulfill Responsibilities 

Nines and thirteens almost univer- 
sally correctly construct a simple 
object following a model. Thirteens 
also almost universally say they would 
ask a teacher if they had an as^gn- 
ment they had to turn in tomorrow 
and hadn't understood what it was 
to be. Seventeens and adults also 
almost universally identify the cor- 
rect Of four least worthwhile ques- 
tions to ask when consulted by a 
supervisor about getting out a new 
rush manufacturing order. It appears, 
then, that initiative exists fairly uni- 
versally in the forms and at the ages 
\tested in NAEP. 

Summary 

Responsibility for one's own behavior 
and Its consequences might spurt 
between thirteen and seventeen On 
the other hand, initiative progresses 
to almost universal proportion from 
nine to thirteen to seventeen in'terms 
of imitating a simple model In con- 
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strXiction, inquiring when stuck on 
an assignement, and inquiring when 
having to plan a more complex man- 
ufacturing task. 

HAVE POSITIVE ATTITUDES 
TOWARD WORK 

A. Recognize the Bases of Various 
Attitudes Toward Work 

Thirteens, seventeens, and adults 
recognize age, race, sex, appearance, 
and personality/manners in about 
equal proportion as one of six rea- 
sons why people who want to work 
find It hard to get work. Also the 
attitude that one can like a repetitive 
job is reasonably entrenched among 
adults but not seventeens. Seventeens 
and adults give acceptable reasons 
for the liking of repetitive jobs in about 
^qpal proportions as well. It appears, 
then, that discriminatory hi'ring prac- 
'tices are known by thirteen but that^ 
understanding why persons continue 
in repetitive work doesn't become 
highly vjsible m the population until 
the aduft age. 

B. Seek Personal Fulfillment 
Through Own Achievements 

Declaring only one's self as respon- 
sible for finally deciding what work 
one should do becomes reasonably 
entrenched by thirteen. Raising race 
horses, giving to charity, traveling, 
and learning new things become rea- 
sonably entrenched or almost uni- 
versal at nine v^thin the fantasy of 
being a millionaire. 

C. Value Work in Terms- 
of Societal Goali 

Thirteens, seventeens, and adults 
advance steadily toward virtual uni- 
versality in adult years of the belief 
that child labor laws should be con- 
tinued. A moderate number of seven- 
teens and adults believe that these 
laws should be continued to protect 
the well being of children, to let them 
gam an education unencumbered by 
work, and because children are not 
qualified for work. There is a relative 
absence in all three age groups of 



belief that the laws should be* con- 
tinued because parents or employers 
exploit children and because keeping 
children from working allows more 
adults to be employed. 

Summary 

Discriminatory hiring practices and 
justifications of child labor laws are 
reasonably understood by a majority 
of thirteens and beyond Learning 
new things if one hc^d money to do 
so is elected as a possibility among 
a majority of nines and finally decid- 
ing what work one should do by one's 
self becomes reasonably entrenched 
by^thirteen but understanding why 
persons continue in repetitive work 
doesn't entrench reasonably firmly 
until adult years. 

OVERALL SUMMARY 

Although Americans almost univer- 
sally report themselves at work as 
adults and also report that their work 
does give them a sense of satisfac- 
tion, there is still a lot that remains 
to be done in preparing youths and 
young adults for making career de- 
cisions. Results indicate that Ameri- 
cans don't confer with counselors 
much about their career plans. Ameri* 
c^ns do have a reasonable amount 
of very common occupational knowl- 
edge but they lack skill in translating 
their interest into job possibilities. 
However, at least by seventeen, Amer- 
icans do have an initially different 
tiating career pjanning field which 
includes knowledge of three or more 
jobs and an awareness of how to go 
about getting job knowledge when 
needed. 

Chores, common activities, visits, 
and lessons abound amOng American 
youths These activities can form the 
basis of career skill and development 
if focused with such purposes in mind 
as they occur or relatively soon after- 
wards The results of the prior sec- 
tion suggest that such focusing is 
not likely to occur without deliberate 
attention being given to it beyond 
that which existed m'l 973-74. 
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If the career skills tested in the 
NAEP be likened to those of literacy, 
the data on skills generally useful for 
work indicate that the American adults 
are generally lite^rate with regard to 
simple numerical, communication, 
manual-perceptual, information pro- 
cessing, interpersonal, and employ- 
ment-seeking skills. Incidences of 
these Skills largely change after thir- 
teen or seventeen years of age. How- 
ever, when the simplicity of these 
skills IS gauged against the complex- 
ity of today's world, it appears that 
simple career skill literacy is insuffi- 
cient for daily life. These data sug- 
gest to counselors that, while work 
still remains before them in making 
simple career skill literacy universal. 
w<as lie before them in facilitating 
the nnore complex self and career 
development skills which they favor 
and society needs 

The highly critical career skilTof 
differentiating and assuming respon- 
Sfbility for what one causes in one's 
environment acts like it spurts up be- 
tween thirteen and seventeen. On the 
Qther hand, initiative progresses to 
almost universal proportion from nine 
to thirteen to seventeen in terms of 
initiating a simple model in construc- 
tion, inquiring ^hen stuck on an as- 
signment, and Inquiring when having 
to plan a more complex manufactur- 
ing task, 

Finally, discnminato?yv.hirihg prac- 
tices and justification of child labor 
laws are reasonably understood by 
a majority of thirteens and beyond 
Learning new things if one had money 
to do so IS elected as a' possibility 
among a majority of nines and finally 
deciding vyhat work one should do 
by one's self becomes reasonably en- 
trenched by thirteen but understand- 
ing why persons continue in repeti- 
tive work doesn't entrench reason- 
ably firmly until adult years as does 
understanding why child labor laws^ 
need continuation as well, 

It appears then that the rudimentary 
look at early career development 
which the reader can take through 



this National Assessment of Educa- 
tional Progress creates plenty of grist 
for a career counselor's mill The 
NAEP results more than adequately 
testify to how little the counselor 
presently figures m career develop- 
ment as wen as to how little personal 
responsibility and capacity for 'career 
has developed by seventeen to say 
nothing of the adult years from 26-35 
as well Although the American peo- 
ple may have a basic existential ca- 
reer literacy, they remain children m 
the groves of career development 

THE SUB-POPULATIONS 

The survey was administered to a na- 
tional sample of each of the four age 
level groups as noted earlier. How- 
ever, data analyses were completed 
not only for the totai national group 
at each level but also for several sub- 
populations. These sub-populations 
are: 

Sex: Results are presented for males 
and females. 

Race. Results are reported for blacks 
and whites. 

Region: The country has been divided 
into four regions: northeast, south- 
east, central and west The states that 
are included in each region are shown 
m Figure 2. 

Parent Education, Four categories of 
parental education are defined by 
NAEP. These categories include: (1) 
jsJq^S — Those whose parents have 
had no high school education, (2) 
Some-HS —those who have at least 
one parent with some high school 
education, (3) Grad-HS — those who 
have at least one parent who gradu- 
ated from high school; and (4) Post- 
HS — those who have at least one 
parent who has had some post high 
school education. 

Size and Type of Community: Com- 
munity types are identified both by 
the size of the community and by the 
type of employment of the majority 
of people in the community. These 
include: (1) HM — areas in or around 
^cities with a population greater than 
^200,000 where a high proportion of 
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FIGURE 2 

National Assessment of Geographic Regions 
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the residents are in professional or 
managerial positions, (2) LM — areas 
in or around cities with a population 
greater than 200,000 where a high* 
proportion of the residents are on 
welfare or are not regularly employed, 

(3) ER — areas with a population 
under 10.000 where most of the resi- 
dents are farmers or farm workers, 

(4) UF — communities within the met- 
ropolitan area of a city with a popu- 
lation greater than 200,000 outside 
the city limits and not in the high or 
low metro group; (5) MBC — commu- 
nities within the city limits of a city 
with a population over 200,000 and 
not included in the high or low metro 
groups; (6) MC — city with popula- 
tion between 25.000 and 200,000. and 
(7) SP — communities with a popula- 
tion of less than 25,000 and not in the 
extreme rural group. 

The analyses of responses generally 
include not orxly national percentages 
for each age group but also percent- 
ages for sub-populations that differ 



significantly from the complete age 
group. Standard errors were com- 
puted for each sub-group P-value. 
and a sub-group is considered to be 
significantly different if the obtained 
difference between the sub-group and 
the total group is at least twice as large 
as the estimate of the sub-group stan- 
dard error. This Story of Early Career 
Development will often report these 
differences in such statements as, 
"Females scored higher than the age 
group as a whole." It is important to 
note, however, that when these sub- 
group differences are reported, the 
causes for the differences in achieve- 
ment levels cannot be ascribed solely 
to membership in a particular group. 
Indeed, age group differences cannot 
be reported as independent, since 
each respondent is a member of five 
different sub-groups. Furthermore, 
it would be tedious to report every 
difference that is statistically signifi- 
cant, especially when a difference 
does not appear to be substantively 
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important or mterpretable The au- 
thors have, therefore, exercised indi- 
vidual discretior> in reporting sub- 
group differences, but for the most 
part» the reader can presume that the 
absence of a P-value m a cell of a 
table Signifies that the value was not 
significant. In such cases, the P-value 
reported for the nation as a whole is 
the one which prevails, with just 
chance variation, m the sub-popula- 
tion in which the P-value is.absent. 

OTHER COD ASSESSMENT RESOURCES 
NVGA-AMEG Series 

This publication is one m a series of 
publications developed by the NVGA- 
AMEG Commission on National As- 
sessment with support from the 
National Advisory Council on Career 
Education and the National Assess- 
ment Project These publications are 
available from Publication Sales, 
. American Personnel and Guidance 
Association, 1607 New Hampshire 
Avenue, N W., Washington, D.C 
20009 Publications m this series 
include: 

Tiedeman, D V , Katz. M R . Miller-Tiede- 
man. A., and Osipow. S H Cross-Sec- 
tional Story of Early Career Development 
as Revealed by the National Assess- 
ment of Educational Progress Washing- 
ton, DC National Vocational Guidance 
Association, and Association for Mea- 
surement and Evaluation m Guidance, 
1978 (order #72219) $7 75 APGA mem- 
bers, $8 75 non-members 

Miller, J M., Career Development Needs 
of Nme-Year Olds Implications for Ca- 
reer Development Programs. Washing- 
ton, DC National Vocational Guidance 
Association, and Association for Mea- 
surement and Evaluation in Guidance, 
1978. (order #72215) $325 APGA mem- 
bers, $4 25 non-members 

Aubrey, R F., Career Development Needs 
of Thirteen-Year Olds' Implications for 
Career Developmerit Programs Wash- 
ington, D C . National Vocational Guid- 
ance Association, and Association for 
Measurement and Evaluation in Guid- 
ance, 1978. (order #72216) $4.25 APGA 
memt)ers, $5 25 non-members 

Mitchell. A, H . Career Devetopment Needs 
of Seventeen-Year Olds Implications 
for Career Development Programs Wash- 
ington, D.C • National Vocational Guid- 
ance Association, and Association for 



Measurement and Evaluation in Guid- 
ance. 1978 (order #72217) $4 75 APGA 
members, $5.75 non-members 
Wfestbrook, B, W., Career DeveloptDent 
Needs of Adults. Implications for Career 
Development Programs Washington. 
D.C. National Vocational Guidance As- 
sociation, and Association for Measure- 
ment and Evaluation m Guidance, 1978 
(order #72218) $275 APGA members, 
$3 75 non-members 

NAEP Series 

The NAEP project has also developed 
several reports related to the COD 
assessment These are available from 
National Assessment of Educational 
Progress, Suite 700, 1860 Lincoln 
Street, Denver, Colorado 80295 
Career and Occupational Development 
Technical Report Exercise Volume Ca- 
reer and Occupational Development 
Report No. 05-COD-20. 

For exercises that have been released, 
this volume provides a copy of the exer- 
cise, complete documentation about 
administration and scoring procedures 
and national results for each foil and/or 
scoring category. 
The First National Assessment of Career 
and Occupational Development An Over- 
view Career and O.ccupalional Develop- 
ment Report No. 05-COD-OO. 
Adult Work Skills and Knowledge Selected 
Results from the First National Assess- 
ment of Career and Occupational Devel- 
opment. Career and Occupational De- 
velopment Report No. 05-COD-01 
An Assessment of Career Development 
Basic Work Skills Selected Results from 
1he First National Assessment of Career 
and Occupational Development Career 
and Occupational Development Report 
No 05-COD-02. 
Objectives for Career and Occupational 
Development (1971) National Assess- 
ment of Educational Progress 

This volume contains all of the COD 
objectives v^hich were samples for the 
1973 assessment which is described m 
this publication series. 
Revised Objectives for Career and Occu- 
pational Development (1977) 

This volume contains the COD objec- 
tiyes which will be sampled for the sec- 
ond COD assessment which is targeted 
for 1978 
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Eleven-Year Career Stability and Change as Reflected 
in Project TALENT Data Through the Flanagan, Holland, 
and Roe Occupational Classification Systems 



DONALD H. Mclaughlin 

American Institutes for 
Research 

Palo Alto, California 
DAVID V. TIEDEMAN 
Northern Illinois University 
The vocational p&ychologist seeks 
classifications of occupations 
which nnaxinnize career stability 
as occupations change from time 
to time In the life. This study in- 
vestigates the extent of cafeer 
stability and the patterns of ca- 
reer change which have occurred 
in the lives of Project TALENT 
twelfth grade students in the 11 
yr elapsing since they were tested. 
'^Career" plans in the last year 
of high school and at 1 , 5, and 11 
yr after testing were classified 
by the Flanagan, Holland, and Roe 
occupational classification sys- 
tems In order to study the career 
stability and patterning within 
each system and to contrast both 
arpong systems. Career stability 
proved to be about the same in 
all three classification systems 
but decreased in all cases as the 
interval over which it was mea- 
sured increased. Career stability 
Increased as subjects grew older, 
proving to be the greatest from 5 
to 11 yr after high school. Pat- 
terns of change mildly conformed 
to the circular pattern^ claimed 
by Holland and Roe for their sys- 
tenns and the linear pattern hy- 
pothesized for the Flanagan sys- 
tem. Generally^ the direction of 



"career" flow was away from in- 
tellectual careers to careers in 
business and sales but each sys- 
tem had unique results as well. 

A person's career consists of not 
merely a particular job but rather of 
a set of occupational activities in 
which he engages and through which 
he seeks progressively to reach his 
life goals. In pursuit of his career a 
person is likely to change jobs at 
least once and possibly several times. 
Sometimes, however, a job change 
is also a career change. Any attempt 
to study career stability, therefore, 
depends on the way in which one 
classifies occupations. In order to 
make meaningful general statements 
about careers, the vocational psychol- 
ogist seeks a classification of occu- 
pations which maximizes career sta- 
bility, the extent to which people 
remain in the same^ career even when 
changing jobs. Only when using an 
occupational classifiqation exhibit- 
ing a high level of career stability will 
the researcher and the counsefor be 
able to make long-term generaliza- 
tions. 

Of course, if all jobs are grouped 
into a single "career," career stabil- 
ity is perfect, artifSctually. A classifi- 
cation must convey some information 
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in order to be useful, and the extent 
to which It conveys information is 
also the extent to which the expecta- 
tion by chance of career-stability de- 
parts from perfection. The more cate- 
gories a classification has. the more 
likely It is that a change of jobs will 
be called a change of careers. Alter- 
native proposals for career definition 
should be evaluated on the extent to 
which they corwey stable rnformation 
about careers 

In this paper, three classifications 
of occupations are applied to the data 
for Riroject TALENT subject?? Occu- 
pational choices and other informa- 
tion were recorded for these people 
in twelfth grade {I960) as well as 1, 
5. and 11 yr after high school grad- 
uation (1961. 1965, 1971). The con- 
clusions concern the relative stabil- 
ity of careers over the various time 
intervals for the three occupational 
classification systems and the struc- 
ture in the distribution of career 
changes that occur 

THREE OCCUPATIONAL 
CLASSIFICATION SYSTEMS 

Holland (1970) and Roe (1956) both 
have systems of occupational classifi- 
cation which are m wide use Flana- 
gan (1971) has also devised a system of 
career graups which has already been 
^used in Project PLAN and is the cen- 
'tral organizing theme of Career Data 
Book Results from Project TALENTs 
Five-Year Follow-Up Study (Flana- 
gan, Tiedeman, Willis. & McLaughlin, 
1973) 

Flanagan's occupational classifi- 
cation system consists of 12 career 
groups numbered and labeled as 
follows 

Number Group 

1 . Engineering, physical sci- 

ence, mathematics, and ar- 
chitecture 

2 Medical and biological sci- 
ences 

3 Business administration 

4 General teaching and social 
sen/ices 



5 


Humanities, law, social and 




behavioral sciences 


6 


Fine arts, performing arts 


7 


Technical jobs 


8 


Proprietors, sales 


9 


Mechanics, industrial trades 


10 


Construction trades 


11 


Secretanal-clerical, office 




workers 


12 


General labot-, community 




and public service 



The occupations which Flanagan 
assigns to each of the 12 career 
groups were initially defined in Flan- 
agan, Shaycoft, Richards, and Claudy 
(1971). They were based on the slmi- 
lanty of high school profiles of abili- 
ties and. interests of people in dif- 
ferent occupations 5 yr after high 
school. Flanagan subsequently slightly 
modified the location of a few occu- 
pations for the Career Data Book Thdf 
resulting system was used in this 
study. 

Holland includes only six occupa- 
tional groups in his classification, 
system. The system^ was initially de- 
fined by Holland (1959) on the basis 
of a^ model of types of jOb environ- 
ment and matching personality types 

The classification used in this study 
was as follows. 
Number Group , 



1 Realistic 

2 lr\vestigative (formerly intel- 
lectual) 

3 Artistic (formerly number 6) 

4 Social (formerly number 3) 

5 Enterprising * 

6 Conventional (formerly 
number 4) 



Roe (1956) grouped occupations 
into eight categones in her classifi- 
cation system. The numbers and 
names of the Roe groups^ are as 
follows' 



^ Upon recommendation of Dr. Holland. 
Dr Gerald D Williams served as referee 
of our assignment of TALENT occupations 
to Holland groups Dr. Roe kindly refereed 
our assignment of TALENT occupations to 
her groups 
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Number Group 



1 Service 

2 Business contact 

3 Organization 

4 Technology 

5 Outdoor 

6 Science 

-J Genera) cultural 

8 Arts and entertainment 



There.isa good deal of communality 
among^the occupational groups of 
the Flanagan, Holland, and Roe occu- 
pational classification systems. The 
extent of the communality is shown in 
detail in Table 1 where Flanagan, Hol- 
land, and Roe classifications of the 
number of people pfenning for. careers 
in 34 different occjupatlons are ar- 
rayed The data in Table 1 are based ^ 
on responses to a 34-way classifica- 
tion of high school career plans on 
a question in Project TALENT'S i960 
Student Information Blank. That ques- 
tion and Its limitations for compari- 
son of occupational classification 
systems are explained in detail be- 
low. Here we merely note that the 
data do not portray the full range of 
variability in occupational classifica- 
tion resulting from use of the thre^ 
systems Even so. the data of Table 
1 do indicate that the three systems 
are not identical. The Flanagan sys- 
tem tends to stress level and kind of 
education in its categories more than 
the Holland and Roe systems, the 
Holland system lends to stress psy- 
chological function satisfied by the 
occupation more than the other two 
systems, and the Roe system tends 
to stress the kind of work done more 
than the other two systems 

Project TALENT 

During 1959-1960, an approximate 5% 
stralifjed random sample of public, 
parochial, and private high schools 
was selected for inclusion in Project 
TALENT Approximately 400.000 stu- 
dents in grades 9-12 were included 
ir^ the Project by this procedure, and 
each of the students sat for a 2-day 
battery of tests and inventories during 
Spring, i960. The TALENT test bat- 
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tery consisted of numerous informa- 
tion, achievement, and aptitude tests 
and also of three questionnaires or 
inventories. The design of the project 
IS described in detail in Flanagan ef a/. 
(1962). 

The only item from this extensive 
1960 testing which is used in this 
study is an item from the Student In- 
formation Blank which required the 
student to indicate his plan for a ca- 
reerupon completion of hiseducation 
The item was given to the student in 
the following form 
In the following list of occupa- 
tions, mark the one occupation 
you expect to make your career 
after you have completed your 
education. If your choice is not 
on the list, mark the one that is 
closest to It. Mark one 6f those 
even if you have not definitely 
made up your mind 
A. Accountant ^ 
B Biological scientist (biolo- 
gist, botanist, physiologist, 
zoologist, etc.) 
C. College professor 
p. Dentist 

E. Engineer (aeronautical, civil, . 

chemical, nrechanical. etc.) 
F Elementary school teacher 
G. High schoolteacher 
H Lawyer 
I Mathematician 
J Pharmacist 

K Clergyman (minister, priest. 

rabbi, etc.) 
L Physical scientist (chemist, 
geologist, physicist, astron- 
omer, etc.) 
M. Physician 

N. Political scientist or econo- 
mist 

0. 'Social worker 
P. Sociologist or psychologist 
Q. Armed forces officer 
R. Artist or entertainer 
S Businessman 
T. Craftsman 

U Engineering or scientific 

aide 
V. Forester 
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TABLE 1 

Frequency of Expressed Career Plarts. of Twelfth Grade Males in the 1960 Project TALENT Sample, 
in each Combination of Categories of the Flanagan. Holland, and Roe Classification Systems" 



TABLE 1 

elfth Grad 
Flanagan. 

Holland Classification . Roe Classification 



Total 



7 ^ 8 



— ^ 






















2446 




715 
976 






Flanagan Classificatton 1 




3161 










3161 








275 




* 2 


275 


952 




24 






1251 








180 






3 




624 






882 


582 


2088 


444 


882 


582 






1079 




4 






1135 






1135 


56 














5 




158 


73 


88 


401 




720 


99 












621 


188 


6 






188 








188 
















7 




138' 




47 






185 








138 




47 






8 










139 




139 




139 














9 


959 












959 








959 










10 


141 












141 






141 












1'1 












46 


46 






46 




437 








12 


570 


245 




69 






884 


447 














Total 


1945 


5278 


261 


1363 


1422 


628 


10897 


1046 


1021 


769 


3713 


712 


1738 


1700 


188 



Holland Classification 1 > 133 141 959 712 

/ 2 788 2764 1667 

3 



73 188 

4 125 71 1167 

5 1021 ^ 401 ^ 

6 628 



■ Note. Only subjects who responded to the 1971 follow-up are included in this study. 
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W. Medical or dental techni- 
cian ^ . 
X. Nurse 
Y. Pilot, airplane 
Z. Policeman or fireman 
AA. Secretary, office clerk or 

typist 
BB, Writer 

CC. Bartier or beautician 

DD. Enlisted man tn the armed 

forcfes 
EE. Farmer 
FF. Hoiiisewife 

G6. Salesman or saleswoman 



HH. Skilled worker (electrician, 
" machinist, plumber, printer, 
etc.) 

II. Structural work^ (brick- 
layer, carpenter, painter, 
paperhanger, etc.) 
JJ, Some other occupation dif- 
ferent from any above. 

These 34 occupations (excluding 
responses "FF" and "JJ"), which we 
call **1960 occupations," were each 
classified under the Ffanagan, Hol- 
land, and Roe occupational systems, 
and the results of this classification 



TABLE 2 

Placement of "196D Occupations" into the 
Occupational Groups of Three Classification Systems ' 

Flanagan Category Holland Category Roe Category 



Engineer 


1 


2 


4 


Mathem|l^tician 


1 


2 


-6 


Physical scientist 


1 


2 


' 6 


Biological scientist 


.2 


2 


6 


Dentist 


• 2 . 


2 


6 


Pharmacist 


2 


2 


6 


Physician 


2 


2 


6 


Nurse 


2 ^ 


4 


6 


Forester 


2 


, 1 


5 


Armed Forces Officer 


3 


2 


1 


Airplane pilot 


3 


2 


4 


Businessman 


3 


^5 


2 


Accountant 


3 


6 


3 


Social worker 


4 


4 


1 


Elementary school teacher 


4 


4 


7 


^High school teacher 


4 


4 


7 


Clergyman 


. 4 




" 7 


College professor 


5 


4 


7 


Lawyer 


5 . 


5 


7 


Writer 


5 


3 


7 


Political scientist or economist 


5 


2 


7 


Sociologist or psychologist 


5 


2 


• 1 


Artist or entertainer 


6 


3 


8 


Engineering or scientific aide 


7 


2 


4 


Medical or dental technician 


7 


4 


6 


Salesperson 


S 


5 


2 


Craftsman 


9 


1 


4 


Skilled worker 




1 


4 


Structural worker 


10 


1 


• 4 


Secretary, office clerk, or iypist 


11 


6 


3 


Farmer 


12 


1 


5 


Policeman or fireman 


12 


1 


1 


Enlisted man in the Armed Forces 


12 


^ 2 


1 


Barber or beautician 


12 


* 4 


1 
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are reported in Table 2 The table 
indicates that there is at least one 
of the 1960 occupations m each group 
of each of the three classification sys- 
tems However, tHfe table also reveals 
that the distribution is not uniform 
This IS not surprising in view of the 
fact that the item was not designed 
With any one of the classification sys- 
tems in mind However, because only 
34 categories of occupations appear, 
. the analyses of this study wHich re- 
,lat,e to the 1960 occupational plan 
data must be viewed with caution 
The data for 1961, 1965. and 1971 were 
based on free responses and were 
subjected to a much finer and more 
extensive occupational classification 
(over 200 categories) 

Project TALENT'S students h^ve 
been followed up 1, 5, and 11 yr after 
their expected years of graduation 
The 11-yr follow-up is stilUn progress, 
however, data from the 1960 twelfth 
grade 11-yr follow-up have just re- 
centiy become available This study 
was therefore limited to the twelfth 
grade data from Project TALENT The 
present results can be subject to veri- 
ticStion as the results of the three 
remaining eleven year surveys be- 
come available 

The data included in this study are 
limited to males Occupational van- 
ability IS greater in TALENT'S males 
than in its females due to the stability, 
of the housewife career among ?ts 
subjects (Flanagan, Shaycoft. Rich- 
ards, Claudy, 1971) Nevertheless, 
there is still considerable career 
activity amor* the* females partici- 
pating in TALENT, and females will 
be incorporated into future TALENT 
research ihto the issues investigated 
in the present study 

TALENT students are asked what 
their occupation is or will be each 
time they are surveyed The occupia- 
tion named is coded into four and 
three digit codes Those codes formed 
the bases of the codirig for the Flan- 
agan', Holland, and Roe classification 
systems which is reported in this 
study 




The Problem 

As indicated, we have data on TALENT 
males which indicate the occupation 
they intended to pursue when they 
reported in 1960. We then have re- 
ports on the occupations they were 
pursuing in 1961, 1965, and 1971. 
From previous analyses, we know 
that overall for males, at the time 
of the five-year follow-up. only 
18.6% of the 12th graders still planned 
the career they had chosen in high 
school. . ' (Flanagan. Shaycoft. 
Ricnards. & Claudy, 1971, -pp 3-10) 
These results are in terms of a few 
more than the 34 career areas listed 
above for item 211 in the 1960 Stu- 
dent Information Blank This, stabil- 
ity valufe probably drops as the time 
between initial and current occupa- 
tional plans increases. Hence, it 
seems reasonable to assume that oc- 
cupational stability IS small over the 
period from stated plan while m high 
school to 1 1 yr after year of expected 
high school graduation. The question 
then arises as to whether there are 
categories of occupations for which 
the stability is greater We shall refer 
to the stability of membership m a 
category of one of the three classifi- 
cation systems as "career stability." 
Thus, from the point of the Flanagan 
system, careers* correspond to lev- 
els and-kinds of education, from the 
point of vf8w of the Holland system, 
they correspond to psychological 
functions, and from Roe's point of 
view, they correspond to the kind of 
work done 

, Furthermore, neither the extent to 
which the different career definitions 
V change in stability nor the extent to 
which career changes njatch patterns 
predicted by the three models are 
knovyn Over the 11-yr post-high-school 
period. In the present analysis. of the 
Project TALENT data, the Intent is to 
evaluate the relative stability pf the 
different classiffcation systems over 
different^inqe intervals and to observe 
the extent to which frequencies of 
career change conform to the models 
underlying the systems. 
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METHOD 

A good deal of the method used to 
compare career stability was outlined 
in the previous section As noted, the 
occupational plan recorded in a male's 
senior year in high school (1960 data) 
IS compared with his occupational 
plan 1 yr (1961 data). 5 yr (1965 data) 
and 11 yr (1971 data) after initial test- 
ing Stated occupational plans are 
used in this study, rather than actual 
occupations, because 1 and 5 yr after 
high school. sub|ects preparing for 
many professional careers will not 
have entered into actual jobs m their 
career field However, plans are '*<puri-. 
fied" to remove people with plans 
who have not begun preparing to 
Scarry them out by 5 yr after high 
school 

. Occupational category membership 
IS obtained^ relat^,ve to the Flanag^^an, 
the Holland, and the Roe occupa- 
tional classification systems for all 
twelfth grade male subjects for whom 
Project TALENT has 11-yr follow-up 
data For each of the six time intervals 
(1960-1961. 1960-1965, 1960-197f. 
1961-1965. 1961-1971. and 1965-1971) 
the stability of the occupational clas- 
sifications IS measured 

Each earlier occupational plan is 
cross tabulated against all later occu- 
pational plans for the same subject 
The percent of students who do not 
vary in occupational class ("career") 
from an earlier to a later observation 
IS then computed for each classlfi- 
catory system in each combination 
Since the Flanagan, Holland, and Roe 
systems of occupational classifica- 
tion have 12. 6. and 8 groups, re- 
spectively, unless allowance is made 
for the different categories, we would 
expecJt the system with the fewest 
categories, namely the Holland sys- 
tem, to reflect the highest stability 
The expectation of'apparent stability 
in a /c-category system with a random, 
uniform distribution (i e . no real sta- 
bility) IS 1//C For example, stability 
IS perfect, namely 100%, when the 
number of classes in a classificatory 
system is one. Since with fewer cate- 



gories, more artifactual stability is to 
be expected, some standardization for ^ 
number of categories is necessary. * 

m important property of an index 
of ^t3Fility to compare classification 
systems with varying numbers of cate- 
gories rs that It be category-invari- 
ant" Alt^ugh category-invariance 
can be*dehried m various ways, an 
accepted dennition is in terms of in- 
vanance-over-combining-categories 
(see Luce, Bush. & Galanter, 1963, 
for an application to learning mod- 
els). This means that If a second clas- 
sification system is derived from a 
given classification system merely 
by combining some categories of 
the original classification, the index 
of stability of the data should be the 
same for both systems if there were 
no predictability within the combined 
categories 

Two measures which satisfy this 
^category-invariance criterion are 
(1) the amount of contingent infor- 
mation in the bivariate distribution 
and (2) any function of the chi-square 
contingency measure These mea- 
sures have^a drawback m common 
as usually defined they measure de- 
pendence in off-diagonal as well as 
diagonal cells. Therefore we shall 
specifically define the stability mea- 
sures repbrted here not to include 
off-diagonahpredictability. In so do- 
ing. It turns out that the combining- 
categories condition is slightly vio- 
lated, therefore, stability measures 
ha^e been computed both^ including 
and excluding off-diagonal depen- 
dence to permit comparison 

One of the almost-category-invar- 
i-ant ' measures of the "stability" of a 
bivariate distribution js derived from 
the amount of contingent informa- 
tion conveyed (Garner, 1962). For a 
bivariate distribution the amount of 
contingent information (or uncer- 
tainty) IS a nominal scale analogue of 
covariance. It is calculated as the dif- 
ference between the actual uncer- 
tainty of the bivariate distribution 
,and the uncertainty of an independent 
bivariate distribution with the same 
marginals. 
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The measure of -contingent infor- >^ first dimension (earlier cLassjfi- 
mation between earlier and later c^y<!^Uox\)^fe the same as the marginals 
reers is the amount of reducUon^pt of tj^e second dimension (later clas- 
ancertamty about a ^person's latter ^iflcatipn) The distribution of this 
expressed career, achieved when a^ x^-statistlc assuming no dependence 



person s earher expressed career 
IS made knovvn, l?is measured in bits, 
which are' equivalent to number of 
yes-no' questions (^«^ith equiprob- 
able answers) needed to, determine 
.the career, and it is category-invar- 
iant 

However, because we wished to 
include only the dependence due to 
deviation of the mam diagbnal prob- 
abilities from their expected values, 
we also replaced the off-diagonal 
relative trequencies by the values 
Jhey would assume if the only depen- 
dence were on the diagonal. The mea- 
sure of diagonal-contingent uncer- 
tainty then indicated the uncertainty 
reduction about a person's later ca- 
reer that IS the result of knowing his 
earlier career, ignoring ail off-diag- 
onal dependencies 
The second almost-category-invar 



in a bivariate K x K category system 
1^ independent of N and is distributed 
approximately as \^ with K degrees 
of freedom. T^^erefore, the value of 
C expeqted by chance. E(C), for a K- 
category system is approximately K'N 
+ 1 In -the present study, E(C) is al- 
ways between 1 00 and 1 01 The use 
bf C, which IS a comparison with per- 
fect stability, is more fruitful than 
using x^. which is a comparison with 
chance stability, because in all cases 
in this stud^rthe statistical signifi- 
cance , of the x^'^'S great enough to 
make comparisons of levels of sig- 
nificance meaningless 

Patterns of Career Changes 

We have considered the extent to 
whi9h careers are stable However, 
m each of the three classificatory 
systems there are some categories 



lant statistic we use' is C = ix'IN)^ that are considered closer to each 



1. in which the compares the 
observed frequencies to those ex- 
pected when frequencies in diagonal 
cells are constrained to be equal to 
the products /)f the mai^ginals (le. 
to contain no dependence), but other 
cell frequencies ate allowed .to take 
on maximum Jikelihood estimates. 

The statistic C also has « meaning- 
ful interpretation it is the number of 
perfectly discnmmatmg categoneb to 
yvhich. the^ value of is equivalent 
. For example, if for a 12-category sys- 
tem with an W = 5000 the»value Of 
X^ IS 19000. thenMhe systeA is equiv- 
alent to a perfectly discriminating 
three category system The reason 
we can 'make this statenr\ent Is that 
the maximum valOe of x^••^o^a i^^-^ ^) 
bivariate category systeTn fpr partl-^ 
tioning N observations' is^,A/(K - 1), 
assurhing each marginal category has 
at least one observation This^'maxi- 
mum value, it must be noted, can be 
obtained only when the nr^arginals of 



other. We can, therefore, test the v 
validity of the systems by the extent 
to' which career changes, when they 
occur^vconform to the predicted rules 
Flanagan makes no assumption, 
about the order of his groups; how-. 
ev£r from .exammation af his classi- 
.ficalion system we conjecture that 
because his groups with smaller 
numbers prdinarily require more for- 
mal education than groups 7^12. ther^e 
will be more changes or^aller disr 
"tances than expecre<fDy chance 
Holland,. \/ierr>stein. Hao.-Mei Kus. 
Karweit. and. Blum (1^70) on the other 
hand have observed that the corre- 
lations of scores on the Holland in- 
terest test in categories correspond- 
ing to his occupational classificatiorj 
system >are higher when the ogcup^a- 
tions iff his system' are only one gcoup 
apart than when they are two groups 
apart, and higher for two than for 
three groups apart Since Holland 
has found these retationshi(Js to re- 
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verse when groups are four and five 
groups apart, he clairYis evidence 
(Holland et a/, 1970) for the circular 
nature of his classification system 
In short, his group 1 is only one group 
away from his group 6 as the linear 
chain of groups is looped back onto 
itself to connect its two open ends 
Roe nnakes a similar claim for her 
classification system (Roe. Hubbard. 
Hutchinson, & Bateman, 1966) 

In order to test the underlying 
models, the distances between cate- 
gories were arranged m increasing 
order base^ on each model, and the 
ratio of thej^bserved frequencies of 
category shi^s of each distance 
to the frequencies predicted from 
the marginal distributions assuming 
a random distribution of category 
shifts was computed The extent to 
which the resulting function de- 
creases monotonically is a crude mea- 
sure of the fit of the underlying mod- 
els to the data 

In order to gain a better understand- 
ing of the flow of career change, the 
categories in each system were re- 
ordered to maximize the directional- 
ity of the changes The directionality 



in the resulting distributions, arvcl^ 
holw It changed across the time in- 
tervals involved, were analyzed and 
the results are presentMi. 

RESULTS ^ * 
Basic Data 

Bivanate frequency distributions for 
earlier vs later occupational classi- 
fications were computed for each of 
the six <x)mbmations of the four data 
sets for etf^ classification system 
All subsequent amalyses repolled here 
are based on these data The differ- 
ence in total n s for the frequency 
distributions is a function of both the 
follow-up sample attrition and the 
frequency of nonclassifiable re- 
sponses AlW subjects in this study 
have 1971 data. 

The observed and expected pro- 
portions of cases which were in the 
same career are given m Table 3 
All observed proportions are sig- 
nificantly greater than the expected 
proportions (based on the marginal 
distributions) at beyond the 0001 
level of significance The observed 
proportions (1) are similar for the 



TABLE 3 

Percents m Same Categories in Each Comparison for each Classification System 

Year 

1961 ' V 1965 1971 



Year 


Classifi- 
caiion 


Observed 


Expected 


Observed 


Expected 


Observed 


Expected 




F 


54 5 


149 ' 


35 4 


125 


28 6 


11 5 


1960 


H 


57 8 


25 8 


44 7 


22 0 


38 6 


198 




R 


44 1 


146 


34 2 


147 


28 6 


139 


1961 


F 
H 
R 






47 6 
55 9 
53 4 


123 
21 0 
147 


38 '0 
46 4 
42 9 


11 5 
196 
146 



1965 



57 0 
63 3 
61 1 



11 9 
21 6 
169 



Note The expected values are based on the assumption of no tendency to lemain in the 
same career F H, and R refer to the Flanagan. Holland, and Roe classification systems 



TABLE 4a 

Contingent Information Measures of Career Stability 



Later career " 

1961 - ' 1965 " 1971 







Diagonal 


Complete 


Dragonal 


Complete" 


Diagonal 


Complete 




F 


646 


838 


,275 


,421 


,176 


.293 


1960^ 


H 


.413 


.461 


.204 


, ,256 


,144 


,192 




R 


.400 


* .689 


.201 


384 


137 


232 


X 
















Earher ^^g^^ 


F 




,588 


.782 


.376 


582 


H 






,448 


.497. 


,279 


.333 


career 


R 






.619 


,703 


376 


463 




F 










.928 


1,140 


1965. 


H 










642 


• 701 




R 










819 


.914 



Note F. H. and R refer to measures using the Fianagan. Holland, and Roe classification 
schemes, respectively 



TABLE 4b 



V 


r 








Later career 














1961 




1965 




1971 










(C-1)/{K-1) 


C 


{C-1)/(K-1) 


C 


(C-1)/(K-ir 






F 


2 64 


15 


1.71 


07 


1 44 


04 ' 




1960 


H 


1.92 


18 


1 42 


08 


1.30 


.06 




R 


2 18 


17 


1 56 


.08 


1.38 


.05 






F 






2 64 


15 


2.03 


.09 


Earher 


1961 


H 






1.92 


18 


1.59 


.12 


career 


R 






2 50 


21 


1.94 


13 






F 










3^6 


.26 




1965 


H 










2 42 


.28 




R 










• 3.19 


31 



Note F. H. and R refer to measures using the Flanagan. Holland, and Roe classification 
schemes, respectively 



three classification systems, (2) are 
clearly greater for shorter time inter- 
vals than for longer fime Intervals, 
ar^d (3) are clearly greater for later 
time intervals tharr for earlier time 
mtervals These generalizations are 
\n accord with common sense. 



The measures of stability calculated 
from information theory and likeli- 
hood theory are given in Tables 4a 
and 4b. The similarity of the contin- 
gent information measures, with and 
without off*diagonal dependence in- 
cluded, suggests that the primary 
form of the dependence between 
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earlier and later careers is that peo- 
ple tend to stay in the same.<?areer 

Evidently, the classification schemes 
With larger numbers of categories do 
contain sonnewhat more contingent 
information. However, the predict- 
ability IS not extremely high for any 
of the sfystems In no case does a 
classification perform as well as a 
hypothetical one consisting of four 
perfectly discriminating cat^gorles 
However, "it should also be pointed 
out that none of the systems were 
designed with the intent of achieving 
a maximal ^evel of stability 

A measure of the efficiency" of 
ttiexategones can be computed as 
the ratio of the number of perfectly 
discriminating categories achieved 
to the number of categories used in 
the classification: although it is far 
from being category-invariant Be- 
cause the efficiency of a classifica- 
tion scheme that is equivalent to a 



single category should be zero and 
of one that is perfect should be one, 
the value one is subtracted from the 
numerator and denominator of the 
efficiency ratio The efficiency of 
Flanagan categories is slightly less 
than that of the other systems. This 
IS to be expected, if we suppose that, 
in any system, the most discriminat- 
ing categories are chosen first for in- 
cj^usion and later categories account 
for relatively less of the variance. 

All three classification systems show 
essentially the same relative levels of 
career stability across different time 
intervals Therefore, there is no evi- 
dence in the present study to sug- 
gest that people are more stable ac- 
cording to one type of categorization 
At early stages and more stable ac- 
cording to a different categorization 
at later stages 



TABLE 5 

Proportion of Observations Switching Between Flanagan Classifications 



Later category number 

minus % % % % % % 

eaViier category number 60-61 60-65 60-71 61-65 61-71 65-71 



1 1 


23 


26 


2b 


'l4 


08 


' "06 


10 


36 


27 


13 


22 


09 


13 


9 


62 


85 


1 20 


72 


1 06 


06 


8 


89' 


73 


67 


60 


66 


. 93 


7 


20 


32 


32 


30 


44 


63 


6 


135 


1 23 


1 57 


1 37 


1 65 


1 71 


5 f 


2 17 


1 27 


1 13 


1 31 


1 61 


1 46 


4 


1 87 


2 08 


2 94 


2 38 


3 93 


3 59 


3 


2 22 


2 23 


\ 2 29 


2 12 


2 19 


1 81 


2 


4 27 


4 15 


3 96 


4.75 


4 59 


3 99 


1 


3 96 


4 82 


5.46 


4.61 


5 35 


4 95 




54 47 


36 40 


28 56 


47 64 


38 03 


56 96 


-1 


5 89 


8 26 


7 96* 


7 53 


7 84 


4 30 


-2 


3 29 


1029 


10 75 


8 09 


•9 52 


5 18 


3 


3 14 


4 92 


5 50 


3 99 


4 95 


2 84 


4 


3 45 


4 83 


4 77 


3 68 


3 67 


2 55 


-5 


2 22 


3 76 


4 82 


3.34 


4 54 


4 06 


'6 


3 48 


5 26 


5 05 


3 02 


3 18 


1 59 


-7 


1 08 


2 65 


483 


1 41 


2 92 


1 44 


-8 


2 07 


2 79 


3 06 


1 13 


1.42 


54 


9 


. 138 


1 83 


2 49 


95 


1 37 


85 


-10 


62 


88 


^ 96 


.38 


31 


13 


-11 


74 


94 


1.36 


32 


59 


24 


N 


6082 


6601 


9300 


5033 


6406 


6794 
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TABLE 6 , 

Proportion of Observations Switching Between Holland Classifications 



Later category number 

minus 
earlier category number 


% 
60-61 


% 
60-65 


% 
60-71 


* 

% 
61-65 


OA 
TO 

' 61-71 


/o 
R1 -71 


5 


.74 


1 04 


1.20 


1 ,00 . . 


1 07 


53 


4 


2.89 


2.26 


2.56 


2.16 


2.44 


3,11 


3 


3.09 


3.16 


2.96 


2,18 


2 48 


2 16 


2 


3.60 


3.46 


2.99 


3,85 


3.13 


2,10 




12.84 


15.91 


15.10 


8.72 


10 33 


6 65 


0 


57.79 


44.72 


38.65 


55.88 


46 40 


63,32 


-1 


6.63 


7.50 


7,45 


8.11 


8,11 


6 56 


-2 


4.72 


5.81 


5.80 


5,02 


5 87 


3 65 


-3 


4.42 


10.60 


16.61 


'7,04 


11,20 


5.87 


-4 


283 


4.77 


6,16 


5.03 


8,08 


-5.58 


-5 


.43 


76 


,51 


1,01 


.88 


.46 


N 


6496 


6812 


9588 


5324 


6894 


7364 



TABLE 7 

Proportions of Observations Switching Between Roe Classifications 



Later category number 

minus 
earlier category nu5nber 

7 
6 
5 
4 
3 
2 

^ M 
0 

^1 
-2 
-3 
-4 
-5 
-6 
-7 
N 



% 


% 


% 


% 


% 


% 


60-61 


60-65 


60-71 


61-65 


61-71 


61-71 


05 


13 


.1> 


25 


30 


,15 


81 


1.23 


1,47 


1,61 


1.94 


1 05 


1 12 


2 36 


2,76 


2.38 


3.55 


1,83 


3.53 


5 33 


6.83 


519 


7 87 


4 59 


4 02 


6.46 


8.44 


4,23 


5.55 


2 52 


15.27 


10 55 


9.72 


4 09 


4 54 


3.18 


6.09 


12.23 


1571 


7 07 , 


9 47 


8.96 
6{.14 


44.13 


34.20 


28,60 


^53 38 


42.89 


9 45 


10.66 


10,24 


9.01 


10 93 


8.10 


5.28 


5 80 


6 34 


4.09 


5.02 


3,67 


4 37 


5.60 


5.22 


2 36 


2.25 


1>S4 


3.24 


2.63 


2.22 


3 09 


2 58 


1.59 


1.42 


1.56 


1,27 


1 82 


161 


.85 


.96 


1.08 


.80 


1 27 


1.81 


77 


.25 


18 


.26 


13 


31 


.25 


6320 


6737 


9550 


5204 


6698 


7254 



Patterns of Career Cbanges 

Summary data on the "distances" of 
later category numbers from earlier 
occupational category numbers are 
reported in Tables 5. 6. and 7 for the 
Flanagan. Holland, and Roe systems, 
respectively Tables 5, 6. and 7 indi- 
cate the percent of all cases in a given 
combination in which a later category 
differed frooi an earlier category by 
the amount indicated in the first col- 



umn of the table. For instance, Table 
5 reports that 3.9% of the 6082 twelfth 
grade students had a later (1961) 
occupational category number one 
greater than an earlier (1960) occu- 
pational category number. 

In order to determine the extent 
to which these frequencies support 
conjectured structures of the three 
classification schemes (linear for the 
Flanagan categories and circular for 
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FIGURE 1 

Frequencies of Career Changes as a Function of the Distance 
between Category Numbe(§, Relative to Values Expected 
if No Distance Effect Were Present 



(b) Holland (c) Roe 

classification classification 
(a) Flanagan classification (linear) (circular) (circular) 
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• 60—61. 60—65. and 60—71 data combined 
o 61—65. 61—71. and 65—71 data combined 



the Holland and Roe categories), the 
frequencies of transitions as a func- 
tion of distance were divided by the 
predicted frequencies If transitions 
•were randonfi, and the results were 
plotted in Fig. 1. For each system, 
the distances were combined across 
directions (increasing and decreas- 
ing category numbers). For the Hol- 
land and Roe systems, m addition, 
the last category was considered 
adjacent to the first category, so 
that, for example, in the Holland sys- 
tem, categories 1 and 5 were con- 
sidered separated by a distance of 
2(1 6- 5), not 4. 

The frequencies used as the pre- 
dicted values based on a hypothesis 
of no effect, and therefore as the de- 
nominators of the ratios in Fig. 1, 
,*were proportional to the products 
of the marginals of the distributions 
of those who changed categories. 
Thejdata are presented in Fig. 1 sepa- 
rately for transitions from high school 



plans (solid circles) and transitions 
after high school (empty circles). 

There appears to be some support 
for each of the structures, in the 
present data. In each case, transitions 
of greater "distance" are relatively 
somewhat less frequent than transi- 
tions of less "distance" Because of 
the large n, the effects are all highly 
significant However, they do not ap- 
pear to account for a great deal of 
the variance in the frequencies of 
career change, for the Holland and 
Roe systems especially Because the 
frequencies In the Holland and Roe 
systems may be linearly ordered, the 
corresponding ratios of observed to 
expected frequencies assuming a lin- 
ear organization of the categories in 
these systems were calculate^ and 
are presented in Fig. 2. 

There are several reliable "bumps ' 
on the curves that are deviations from 
the conjectured structures, for exam- 
ple, the relative dearth of changes 
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FIGURE 2 

Frequencies of Career Changes as a Function of the Distance 
between Category Numbers, Relative to Values Expected 

if No Distance Effects Were Present 



(a) Holland classification jlinear) 



(b) Roe classification (linear) 
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of distance 7 in the Flanagan sys- 
tem. However, there is no single pair 
of categories or simple explanation 
that reasonably accounts for any of 
these deviations. 

A feature of career changes is the 
extent to which 'they are directionaL 
While some categories appear very 
frequently in earlier plans, different 
categories appear more frequently 
on later follow-ups, Because of its 
conjectured linear structure we might 
expect the Flanagan categories to 
show such a tendency, whereas the 
circular Holland and Roe structures 
would not be expected to have a "top" 
and bottom of the line. In order to 
$hed further light on the nature of 
category changes, the x^ategories in 
each systenn were rearranged to maxi- 
mize the directionality of the flow of 
people between categories. The re- 
sults are shown in Table 8, separately 
for changes from high school plans 
and for changes after high school. 



The directionality is equally great 
in all three systems, perhaps belying 
the applicability of the circular model 
of the Holland and Roe systems for 
accounting for career changes. The 
directionality is significantly greater 
for changes with respect to ^lgh 
school plans, although the difference 
is not large. 

In terms of the Flanagan categories, 
changes tend to be away from careers 
requiring a college degree Category 
3 (Business Administration) shows 
changes away from high school plans, 
but later it becomes the target of 
many changes Category 7 (Techni- 
cal Positions) shows a great increase 
over the number that would have been 
predicted in high school but not a 
great increase later, suggesting that 
people make the change into (plan- 
ning for) a technical career soon after 
high school, if ever. 

In terms of the Holland system, 
changes tend to be away from Inves- 
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TABLES - • 

Direction of Maximal Flow between Careers, 
m Terms of Three Classification Systems 



Transitions from high school plans 
(1960-1961 1965 1971) 



Transitions after high school 
(I96t- 1965 1971 1965-1971) 



Flanagan \ Engineering Phys Sci etc 
System \ Medical Science 

Teaching & Social Services 
Business Administration 
Art 

Hunr>anities. Law etc 
Industrial Trades 
General Labor, etc 
Construction Trades 
Office Workers 
75**o' Y Technical Jobs 
Sales 



Medical Science 
Engineering, F^^ys Sci etc 
Art 

Teaching & Social Services 
Humanities. Law, etc 
Technical Jobs 
Office Workers 
Industrral Trades 
Business Administration 
. \ General Labor, etc 
70 o' V Construction Trades 
Sales 



Holland \ Investigative 

system \ Conventional 

\ Social 
\ Realistic 
76*0 ' \ Enterprising 
\ Artistic 



Investigative- 
Artistic 
Social 
Conventional 
Realistic 
Enterprising 




Roe system 



78" 



Outdoor 
Technology 
Science 
Cultural 
Service 
Business 
Art 

Organization 



67* 



Science 
Cultural 
Outdoor 
Business 
Service 
Technology 
Art 

Organization 



Percentages are of all career changes those that are in the directions of the arrows 
Because Ihe categories have been rearranged to maximize these percentages their values 
expected by chance are slightly greater trrah 50*» (but much less than 60*o) 



tiQabve (Category 2) and toward Real- 
istic (Category 1) and Enterprising 
(Category 5) career environments. 
This result is essentially the same as 
the statement for the Flanagan sys- 
tenn. The change in the position of 

Artistic careers in the two hier- 
archies indicates that there were a 
large nunnber of high school students 
who did not check the alternative 

Artist or Entertainer" or Writer" 
in the' 1960 TALENT item but who 
gave responses in the Artistic" cate- 
gory of Holland s system in the follow- 
ups. Referral to the list of occu- 
pations classified in the "Artistic" 
category on follow-ups suggests an 
artifacutal reason for this, some occu- 
pations were ones which would have 
led to other answers in the 1960 Item 
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(such as college English teacher, ar- 
chitect, public relations, and linguist) 
In terms of the Roe system, changes 
tend to be away from Outdoor (Cate- 
gory 5) and Science (Category 6) ac- 
tivities and toward Organization (Cate- 
gory 3) and Arts and Entertainment 
(Category 8) This is again the result 
of confrontation of individual ideals 
.with economic reality reflected in the 
Flanagan and Holland systems The 
change m the position of "Technol- 
ogy" in the two Roe hierarchies is 
not as clearly the result of an artifact 
as was the shift in Holland s "Artis- 
tic" category A large number of high 
school students checked the alterna- 
tive Engineer" who later turned to 
'Business contact ' and Organiza- 
tion" careers, but between 1 and 11 
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yr after high school there were as 
many becoming technologists" {in- 
cluding skilled tradesmen." repair- 
men,' and general Laborers ) as 
were leaving this category The nnix 
of people in this category was chang- 
ing, however 

CONCLUSIONS 

1. Career stabihty. measured m 
terms of classification systems de- 
veloped by Flanagan, by Holland; and 
by poe. was about the same for each 
system The greater the number of 
categories, the more stability that 
was tapped, although less effi- 
ciently " 

2 Career stability decreased as the 
interval over which it was measured 
increased In particular, there were 
a large number of people with the 
same career plans 5 yr after high 
school as they had m high school, 
or 1 yr after high school, but who 
changed m the next 5 yr 

3. Career stability increased as sub- 
jects grew older, with the greatest 
stabihty m the present study at the 
latest" interval, from 5 yr after high 
school to 11 yr after high school 
Evidence mentioned by Holland ef al 
(1970) on 30-39 -year-olds, who had 
proportions-in-the-same-category of 
70 and 62% for 5- and 10-yr periods, 
IS consonant with the results of this 
study and the assumption that career 
stability continues to increase mod- 
erately after the first decade after 
high school 

4 Patterns of career change mildly 
supported conjecture structures of 
careers underlying the three classi- 
fication systems However, there was 
no more support for the circularity 
of the Holland and Roe structures 
than there was for the assumption 
that they were ordered along a Ime 

5 There was a clear directionality 
of the flow of people across career 
categories, for each of the three sys- 
leVhs Generally, the flow was away 
from intellectual careers to careers 
m business and sales However, there 
were some results specific to each 
of the three systems 
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PROBLEM 

r 

Why do, people happen to enter the 
particular educational programs or 
occupations they do*^ How or why is 
It that they change from one educa- 
tional program or occupation to an- 
p other at various points throughout 
their lives? How can it be explained 
that they express different prefer- 
ences for various programs or occu- 
pations at different times iri their 
'tfves'^ 

A number of attempts has been 
made to understand these phenom- 
ena. What follows IS a social learning 
theory analysis of career decision 
making.* This analysis provides a 
basts for a series of propositions that 
lead to some testable hypotheses and 
provide a framework for a synthesis 
of existing empincal evidence.^ 

The theory presented here attempts 
to explain how educational and occu- 



pational preferences and skills are 
acquired and how selections of 
courses, occupations, and field's of 
work are made. It identifies the in- 
teractions of genetic factors, envi> 
ronmental conditions, learning ex- 
periences, cognitive and emotional 
responses, and performance skills 
that produce movement along one 
career path pr another. Combinations 
of these factors interact In different 
ways to produce different decisions^ 
At each decision point the decider 
has one or more response or deci- 
sion options Internal (personSl) and 
external (environmental) influencers 
(constraints or facilitators) shape the 
nature and number of thofi options 
and the way in which individuals re- 
spond to them. Sometimes so many 
options are available that the indi- 
vidual feelsT incapable of deciding 



^ A description of the empincal evidence 
relevant to this theory has been prepared 
by Anita M Mitcheii and appears as Chap- 
ler 3 in Mitchell, Jones and Krumboltz 
(1975) In Chapter 5 G Brian Jones has 
suggested relevant research and develop- 
ment priorities 



^ Pos'sible prdQltcal applications and a 
suprrlTTcM^txpf thdtheory are discussed in 
l^urTibollzNtMitcnell and pelatt (in press) 
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At other times options may be so 
limited or so disproportionate in 
value that the individual feels only 
one option is available In fact, this 
person might feel she or he has no 
choice. But always there are options, 
even if one of them is not to make a 
decision A decision — the selection 
of an option from among two or more 
alternatives may increase or de- 
crease options available for future 
decisions Some consequences are 
irreversible The decision made within 
an environment becomes part of the 
new environment, and may itself be- 
come one of the^constraints or facili- 
tators in a new setting. This is an- 
other example of the interdependence 
of any series of learning expenences 
and decisions 

The theory allows for modifications 
by future events In no sense is it 
intended as a final statement It should 
be congruent with presently knowh 
facts but It should also suggest fur- 
ther research that may lead to mod- 
ifying part or all of the theory itself 

FACTORS THAT INFLUENCE THE 
NATURE OF CAREER DECISION 
MAKING (CDM) 

F.our categories of influencers are 
posited 

1. Genetic Endowment and Special 
Abilities 

A person is born with certain inherited 
qualities that may set limits on that 
individual's educational and occupa- 
tional preferences, skills, and selec- 
tions Following are some illustrative, 
although not exhaustive, factors that 
may well make a difference 

— Race 

— Sex 

— Physical appearance and charac- 
teristics, including physical defects 
or handicaps that cannot be changed 

The evidence is not clear as to the 
genetic ancf;;^environ mental compo- 
nents pf A^anous special abilities It 
IS not essential for purposes of this 
theory to know at this point exactly 
what portion of the variance is due 



to genetic or environmental influ- 
encers, but It should be recognized 
thatvthe possibility exists that certain 
indjj/fduals are born with greater or 
lelsej predispositions to profit from 
certain types of learning experiences 
Aspects of the following abilities 
might be attributed to such predis- 
positions, while other parts obviously 
result from interactions with environ- 
mental influencers 

— Intelligence 

— Musical ability 

— Artistic ability 

— Muscular coordination 

2. Environmental Conditions 
and Events 

Educational and occupational deci- 
sion making is influenced to a large 
extent by factors usually outside the 
control of any one individual Some 
events may be planned, many others 
are unplanned These environmental 
conditions and events nnay be due 
to human action (social, cultural, 
political, or economic) or to natural 
forces (location of natural resources 
Or natural disasters) As a r^sulrtf 
these factors, certain evenls or con- 
ditions occurlj^^ThYch influence the 
career preference^', skills, and plans 
and activities of the individual 

— Number and nature of job oppor- 
tunities, Asa result of historical forces 
and governmental policies, certaih 
occupational opportunities are avail- 
able in one setting that are not avail- 
able in another Opportunities to bjB 
an abalone fisherman exist in Cali- 
fornia but not in Arizona Opportu- 
nities to be a department store Santa 
Claus are available in certain West- 
ern countries but not in Pakistan. 

— Number and nature of training 
opportunities. Educational opportu- 
nities are available in different cul- 
tures through different social insti- 
tutions. In the United States training 
IS available through public schools, 
•propnetary schools, the armed forces, 
apprenticeship programs in unions 
and industry, and through Correspon- 
dence courses Accessibility of these 



training alternatives varies consider- 
ably from one location to another 

— Social policies and procedures 
for selecting trainees and workers 
Policies and procedures can change 
as a result of new laws or judicial 
decisions For example, the use of 
certain aptitude^ tests Iras b«fn re- 
stricted as a result of recent court 
decisions Requirements for entering 
certain jobs may be modified. The 
requirements may be functional or 
nonfunctional but still have an influ- 
ence on the career selection process. 
For example, the requirement of a 
high school diploma may influence 
certain people to finish their high 
school education even though a high 
school education is not ^necessary 
for successfi^l performance on the 
jOb . * ' 

— Rate of return for vanous occu- 
pations J he ratio of potential pecu- 
niary and non pecuniary rewards to 
the costs of preparing for an pccupa 
tion vanes dramatically from one oc 
cupation to another. The rewards, th^ 
risks, and the costs of preparing for 
any given occupation can be different 
in different cultures and in different 
groups witfiin the same culture, and 
can be Changed within any given cul 
ture as a result of institutional or gov 
ernmental action Trends in*'t4ie rate 
of return for different occupations 
may be identified arid affect future 
planning 

— Labor laws ar)d union rules Rules 
for joining labor uniOns can affect the 
number of new members, the number 
of jOb opf^ortunities, and the benefits 
% —Physical events such as earth- 
quakes, droughts, floods, and hurri- 
canes Disasters such as these can 
destroy, the ecoriomy of a certain lo- 
cation such that individuals employed 
there can no longer continue the 
same type of work ' ' > 

-^Availability of and demand for 
natural resources The owner of land, 
on which oil was discovered un^er 
circumstances where there -was a 
large demand for oil might under- 
standably change his occupational 
activities 



— Technological developments. Ihe^ 
invention of new techniques and 
products produces job opportunities 
that might have been unavail^ible a 
few years previously. Industrialized 
societies therefore produce differ- 
ent patterns of job opportunities than 
less developed societies 

— Changes in social organization 
Setting up the social security system 
in the United States not only pro- 
vided a large number of jobs for 
employees in the federal civil ser- 
vice system but it affected the career 
plans of many individuals. 

— Family training experiences and 
resources An individual is born or 
adopted into a family which Yias 
learned a certain religion, has adopted 
certain values, and which communi- 
cates certain expectations to the new 
child. Families differ in what they 
teach their young^sters and in the"^ 
resources they have available to pro- 
vide for them Such differences pro- 

.duce condijions for the individual 
that may make a difference in that 
individual's educational and occupa- 
tional preferences, skills, and selec- 
tions. 

^Educational system The school 
organization, the administrative poli- 
cies, the type and personality ofifeach- 
ers available to the individulBT can 
have a big, influence on the skills 
learned and the degree" to which the 
individual strives to achieve success 
in various endeavors 

— Neighborhood and community 
influences. Communities differ in 
the.extent to which models of people 
working in different occupations are 
available, the extent to which peers 
have learned differential values, and 
(he extent to which various cultural 
events are available ,and valued , 

3. Learning Experiences 

Educational and occupational decic 
sion making is also influenced b^ the 
individual s past learning experi- 
ences The patterns of stimuli and 
reinforcement, their nature and sched- 
*uh'ng are so exceedingly complex 
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that no theory can adequately account 
for the infinite variations that influ- 
ence the development of career pref- 
erences and skills and the making of 
career selections. Two categories ot 
^ learning^are used here "in an overly 
Simplified form to point out t^he- types 
of experiences that have an impact 
on CDM. 

^Instrumental Learning Experi- 
ences ilLEs). In these the individual 
acts on the environment in such a waV 
as to produce certain consequences 
An H-shaped'figure will be used to 

* represent an instrumental learning 
experience. Figure 1 presents a dia- 
gram to show the components m the 
ILE. Three ge;ne^l components are 
identified, antecedents, covert and, 
overt behavioral re^spanses, and con- 
sequences (including responses to 
these consequences which in turn 
become a part of subsequent learn- 
ing experiences) The antecedents in 
the generafmodel consist of factors 
such as {hose identified in the above 
three sections (eg., the^cultural set- 
ting, the social history of the particular 
group) arid the stimulus character- 
istics of a particular task or probtexn 
that IS presented to-. the. individual. 
Behavioral responses consist of cog- 
nitive and emotional responses as 
well as overt actions. Consequences 
•include both the direct effects pro- 
duced by the action (self feedT^ack, 
verbal feedback from other individ- 

" uals, observable results of the fiction 
itself, immediate or delayed impact 
on othec people) and the cognitive 
and feeling responses the individual 
makes w.hen s/he experienced these 
consequences. Fi^re 1 also presents 
a specific exampife^'Jof antecedents, 

* the overt component of Jiehavior, and 
feedback component of the conse- 
d^u|nces in the fictitfous case Qf 

^ ' Roger. Other examples of mstru- 
' mental learning experiences would 
include knitting a sweater, reading a 
tjook, hitting a basebalf, saymg^ello 
to. a stranger, cutting down ♦afM'ee, 
making an angelfood cake, or kssing 
som*eone of the opposite sex. The 



skills necessary for successful career 
planning, development, and occupa- 
tional or educational performance are 
learned through successive instru- 
mental learning experiences 

— Associative Learning Experi- 
ences' (ALEs) Learning experiences 
also occur when the individuals pre- 
vailing response pattern is a reaction 
to external^ stjmuli Obse/vational 
learning in which the individual learns 
by observving real or fictttious models 
IS include'd in this category of ex- 
periences. 

Also incorporated here are experi-' 
ences in which,two eVents^are paired 
in time or location such tha't the 
learner asso'cia,tes a previously neu- 
' tral'situation with some emotioriall^ 
positive or negative reac;tion Thus, 
for example, hearing or readmg words 
that pair two things togelhfer can haye 
an impact For example, stafe/nents ^ 
such as ''"AlUjawy^rs are crooked" 
or "Plumbers make a lot of rnoney" 
gr ' Those who can, do, those who 
-can't do, teach, those who can't 
teach, teach teachers " SucVi verbal 
stereotypes about occupations influ- 
ence the relative attractiveness or 
unattractiveness of each occupation 
These associations can be learned 
not only through words but through 
images on film, through reading in 
books, throuah observation of peo- 
ple employedltL various occupations, 
and through direct expenence Indi- 
viduals have a tendency to form gen- 
eralizations about entire occupations 
from very few examples, and some- 
times the first associations that are 
formed are the lasting ones 

The pairing of stimuli through the 
classical conditioning paradigm is 
also included here For example, a 
boy who becomes nauseous at the 
' sight of blojod may generalize the 
association to conclude that be- 
coming a physician is inappropriate 
^ for him. 

" The general model for associative 
learning experiences is represented 
in Figure 2 as an 0-shaped diagram 
For simplicity, the cognitive and 
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FIGURE 1 

Diagrams Representing Instrumental Learning Experiences (ILEs) 



.Antecedents 


Behaviors 


Consequences 




Antecedents 


Behaviors 


Consequences 


Genetic 
Endowment 

Special 
Abilities and 
Skills 




Verbal Feedback 
from Set 
and or Others 

Direct 
Observable 
Results of 
Action 




Roger age 17 
white male poor 
muscular coordination 
superior writing skills 




*? 

Teacher gives paper an 
A grade and writes 
Well done Roger 

thinks 1 could have 

done better if 1 had 

to 


Task or 
Problem 


Covert and 
Overt Actions 


Covert 
Reactions to 
Consequences 
(Cognitive and 
Emotional 
Responses) 


• 


Class in Government 
in whirh Pnnpr hfi*'? 

interacted with 
teache.r and 29 
others for 7 months 
Teacher assigns 
paper on A Famous 
Person in Government 
due in 3 weeks " 


Roger (who happened 
to have visited 
Jefferson fvtemorial in 
Washington) writes 
paper on Thoma5 
Jefferson and turns 
It in on time 


u 

Roger has a stimulating 
conversation with his 
father, on how the U S 
would be different 
today if Jefferson had 
not lived ^ 


Planned and 
Unplanned 
Environmental 
(e g . social 
cultural or 
economic) 
Conditions of 
Events 




« 

\ 

Impact on 
Significant 
Others 




Government class 
i/i U S high school 
where athletic 
success isdommani 
basis for male students 




Roger s classmate 
Jock sees teache^ s 
comment and calls 
Roger a teachers 
pet 

f 



Ger\frrai Mode! ' Specific Example, "f^oger" 
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FIGURE 2 

Diagram s Repr esenting Associative Learning Experiences (ALEs) 
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Roger sees movie 
Paper Chase because Jock 
persuaded others that it must- 
be a western set in a logging camp 



Roger sees 
law student 
depicted as 



worthy 

sensitive 

humarr 



General Model 

emotional responses the mdividua) 
makes as a reaction to these associa- 
tions are omitted from Figure 2 The 
top of the diagram describes the cir- 
cgmstances under which the individ- 
ual IS exposeid to paired^stimuti or 
a model, the neutral stimulus or trie 
model IS, represented in the lower 
left quad/ant with an arrow pointing 
to the associated positive or nega- 
tive stiumulus or the consequences 
received by the model Figure 2 also 
presents a concrete example of stim- 
ulus pairing It illustrates how "Roger" 
might learn that law students cotJid 
be considered worthy, sensitive, hu- 
man beings 

4. Task Approach Skills 

As a result of as yet ^unexplained in- 
teractions between genetic ari^nvi- 
ronmental influences, an individual 
brings to eacH new task or problem 
a set of skills, performance standards 
and values, work habits, perceptual 
and cognitive processes (such as at- 
tending, selecting.: symbolic rehears- 
ing, coding; encoding, reflecting, and 
evaluating responses) mental sets, 
and emQtional responses These task 
approach skills affect the outcomes 
of each task or problem. As a result 
of differential outcomes, the task 
approach skills become modified. 



specific Example: "Roger " 



For example, in high school Roger 
qiay cram for final examinations and 
get "A" grades, but in college his 
"cramming" habit may produce poor 
grades The differential feedback may 
convmce him to change his habits 
Thus, task approach skills are both 
factors which influence outcomes 
and outcomes themselves 

OUTCOMES OF INTfRACYlONS 
AMONG INFLUENCERS 

Each individual is exposed to in- 
numberable -learning experiences 
throughoiA the days, months, and 
years of her or his life. These experi- 
ences occur in many sequ'ences. Their 
combinations and permutations are 
virtually infmite.^^ Each instrumental 
learning experience is followed by 
vanous rewards .and/or punishments 
at various intervals of time following 
the behavior and these varying sched- 
ules of reward, in combination with 
other learning experiences with their 
varying schedules of reward, produce 
an arpay of unique experiences which 
contributes to the diversity and indi- 
viduality of the human species. Three 
kinds of consequences are pertinent 
to this analysis. 
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1. Self*Observation Generalizations 
(SOGs) 

As a result of learning experiences, 
an individual can observe her/his own 
performance in relation to the perfor- 
mance of* others or her/his own past 
performance* and can make general- 
izations about It Because the human 
being is capable of speech, s/he is 
able to utter statements which report 
these observations and conclusions 
Comparison with others is usually 
part of the process, but idealized 
standards can be learned against 
which one s own behavior is com- 
pared Figure 3 presents a diagram 
representmg such a self-observation 
generalization An SOG is defined as 
an overt or a covert self-statement 
evaluating one's own actual or vicari- 
ous performa*nce in relation to learned 
standards Figure 3 also presents a 
specific exaftipi.e of such an SOG in 
the case of Roger Not all SOGs 
are necessarily this explicit A per- 
son may have a vague feeling of either 
confidence or discomfort, for exam- 
ple, when aS(J<ed to give an impromptu 
speech The feehng. as clearly articu- 
lated, might be. I know I can give a 
succinct summary of my experience 
which will be well-received by pther 
people because I have done this many 
times before Or. if one s past ex- 
perience had been different, the ex- 
plicit statement might be. Everyone 
will think I m a fool if I stand up and 



try to talk in front of them, just like 
the last time someone made me do 
this " 

Self-observations arid conclusions 
are not necessarily accurate A child 
might do an excellent job by objective 
standards but be told by her or his 
parents that it was poor Without any 
other way to evaluate her or his own 
performance, s/he will learn to make 
negative evaluations about that par- 
ticular behavior When such nega- 
tive evaluations are uttered, their 
expression may be reinforced by well- 
meaning friends who deny the nega- 
tive statement and offer a more posi- 
tive evaluation. Expressing negative 
self-observations then become a 
means of eliciting compliments from 
friends. 

Self-Observations and conclusions 
may be a function of the setting or 
the persons with whom one is asso- 
ciating A boy may describe his bowl- 
ing as superior in the presence of his 
girlfriend but inferior when he is with 
hi^ buddies at the bowling alley Such 
discrepancies can be explained as 
dijferential learning, a process involv- 
ing discriminative stimuli and differ- 
enfial reinforcement Positive self- 
observations and conclusions may 
be reinforced by some a^d punished 
by others An individual accumulates 
both observations about her/his own 
performance and the generalizations 
to various situations but may not 
necessarily make explicit fprmula- 



FIGURE3 

Diaigrams Represeriting a Self-Observatton Generalizj^on (SOG) 
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tions of these ojbservations or reac- 
tions until some suitable occasion 
for verbalizing them occurs ^ 

Psychologists have devised various 
procedures for collecting individuals' 
self-observations and conclusions. 
Interest inventories are one such pro- 
cedure. In some approaches to in- 
terest^ assessment, individuals are 
asked the degree to which they like, 
are indifferent to, or dislike various 
activities such as building a bird- 
house or writing a letter An individual 
may never have formulated an opin- 
ion on these questions before but, 
under the stimulus of the question- 
naire, makes decisions about his 
degree of likmg for each item These 
interests are merely SOGs gener- 
alized from prior learning experiences 
Another such device is an adjec- 
tive checklist in which the individual 
circles adjectives which s/he feels' 
^ are descriptive of herself or himself, 
e g . trustworthy, humorous, attrac- 
tive, shy These sell-descriptive ad- 
jectives are the result of the individ- 
ual s observing herself or himself 
through one'or more learning experi- 
ences and arriving at specific self- 
conclusions 

People tend to remember their reac- 
tions to learning experiences but to 
forget the actual learning experiences 
themselves except when such experi- 
ences are particularly dramatic or 
traumatic So some individuals can 
reliably report on whether they enjoy 
or do not enjoy reading science fic- 
tion but cannot give the names of 
specific science fiction books that 
they have read The success of inter- 
est inventories in predicting future 
occupational selection is probably 
due to the fact that conclusions from 
various learning experiences are mem- 
orable and that people tend to con- 
tinue doing those activities which 
produce pleasurable reactions 

SorTTfetimes psychologists speak of 
interest? as if they cause occupational 
selection However. m*the theory pre- 
sented here, interests are seen as 
consequences of learning 'experi- 



ences It IS the learning expenences 
themselves that have an impact on 
an individual's future development of 
educational and occupational skills 
and selection of a course of study, 
an occupation, or a field of worl^ 

The one most important self-obser- 
vation generalization for the purposes 
of this COM study consists of prefer- 
ences, preferring to work at one task, 
to avoid another, preferring to play 
one sport but to eschew another 
These preferences become an impor- 
tant outcome Of learning experi- 
ences—the building blocks of ca- 
reer decisions 

2. Task Approach Skills (TASs) 

Human beings are capable of relat- 
ing their observations of themselves 
and of their environment in such a 
way as to make possible projections 
into the future as well as inferences 
about the o^t Task approach skills 
are definecM^cognitive and perfor- 
mance abf^B^nd , emotional pre- 
dispositior/s for cS^ping with the envi- 
ronment, interpreting it in relation 
to self-oservation generalizations, 
and making covert or overt predic- 
tions about future events. They 
include work habits, mental sets, 
perceptual and thought processes, 
performance standards and values, 
problem orientating, and emotional 
responses Figure 4 presents the 
general model and a specific exam- 
ple in the case of "Roger" 

More specifically related to the pur- 
poses of the COM study documented 
here. TASs include what may be 
germed COM skills Included are 
skills in value clarifying, goal set- 
ting, predicting future events, alter- 
native generating, information seek- 
ing, estimating, re-interpreting past 
events! eliminating and selecting al- 
ternatives, planning, and generalir- 
mg (Krumboltz and Baker, 1973) Evi- 
dence about the extent to which 
people can apply these skills can be 
inferred from their behavior in mak- 
ing decisions and from their self- 
reports Here are some self-reports 
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FIGURE 4 

Diagram s Repr esenting Task Approach Skills (TAS$) 



/Cognitive and performance abHities 
and emotional predtspositions for 
coping wjth the environment, 
interpreting it in relation to s^lf- 
observation generalizations, and 
making covert and overt predictions 
about future events c 



General Model 



I m good at writing but lousy in 
sports Law seems to attract either the 
rpost moral or the most unscrupulous 
types of people I wonder if I could cut 
the mustard in law school How could I 
find ouf? y 



Specific Example: "Roger** 



which illustrate TASs The last time 
I faced a problem like this I talked it 
over with^my friends before deciding 
and I felt that it helped me reach a 
better decision Maybe I'd better do 
that now. Or, According to this 
pamphlet the demand for computer 
programmers is going to be much less 
ten years from now than it is now But 
1 wonder if the person who wrote this 
pamphlet really knows. I certainly do 
enjoy working with computers Maybe 
by the time I'm old enough to taRe a 
full-time job the specific Vequire'ments 
will be quite different, than they are 
now. I wonder if it does any good to 
plan ahead," 

The nature of any TAS for an indi- 
vidual depends upon the sequence of 
her/his pnor learning experiences, 
including any genetic factors that 
influenced those experiences Indi- 
viduals can acquire and perform 
sequentially related skills that both 
build on competencies already in 
their repertoires and enable them 
to complete tasks needed for making 
future career decisions 

Actions 

Some behavior is the ultimate out- 
come of the processes described 
above. Each behavior generates con- 



sequences which affect the relative 
frequency of similar behaviors in the 
future. 

This study of a social learning ap- 
proach to CDM IS specifically con- 
cerned here with entry behaviors, 
those actions which represent an 
overt step in a career progression. 
Examples include applying for a'spe- 
cific job. applying to a specific school 
or training program, accepting a job 
offer or training opportunity, accept- 
ing a promotion, and changing a col- 
lege major. 

THE PROCESS OF CAREER PLANNING 
AND DEVELOPMENT 

Consider an individual human being. 
She is born into the world with cer- 
tain heredity. Her first view of the 
world is an antiseptic hospital with 
trained doctors and nurses in atten- 
dance. Immediately events begin im- 
pinging on her, She is slapped on 
the bottom. She feels cold. She cries. 
She finds a breast or a bottle. She 
cannot verbalize it yet but her sub- 
sequent behavior reveals that she 
might have been formulating an SOG 
which states, "Aha, 'crying produces 
warmth and milk for me." From her 



very first moment, on earth, the pat- 
tern of learning experiences has 
begun 

A general model outlining factors 
affecting educational and occupa- 
tional decision making is diagrammed 
m Figure 5 On the left side are the 
genetic factors represented m the 
newly-born individual. Time moves 
from left to right The underlying 
environmental, economic, social, 
and cultural events and conditions^ 
impinge upon the individual s learo^ 
ing experiences as the arrows u;rai- 
cate The individuals learnK>g ex- 
periences are represented b/ihe 0 s 
and H s defined m Figure* f and 2, 
while triangles and parallelograms 
which have been defined in Figures 
3 and 4 represent adclitional'products 
and thought processes. The triple 
arrows after certain events represent 
the fact that the event which subse- 
quently followed did not necessarily 
have to follow at that point Each 
individual can make choices. Other 
alternatives were equally possible, 
though not necessarily under the 
control of the individual involved 
The ellipses ( ) indicate that large 
amounts of time and therefore large 
numbers of learning experiences as 
well as environmental events have 
been omitted in order to save space 
Mn this diagram The general model 
shows that as a result of the mterac* 
lion of genetic factors, environmental 
factors, and a complex sequence of 
learning experiences, she arrives at 
a certain point in time at her current 
activity In no sense is that current 
activity the final career activity As 
lime continues, further events and 
learning experiences occur, and edu- 
cational and occupational activities 
may change 

As discussed in the preceding sec- 
tions, learning experiences produce 
not only preferences (emotional re- 
actions of liking or disliking) for 
various activities but cognitive and 

performance skills as well This indi- 
vidual can observe herself engaging 

in a skilled performance and can 



obtain reactions from other people 
about the quality of that performance 
The consequences of each learn- 
ing experience affect the probability 
that she will. have a similar learning 
experience in the future A success- 
ful performance or positive feedback 
from other people increases the prob- 
ability that certain types of activities 
will be repeated and therefore that 
certain types of skills will be devel- 
oped to a greater extent If she ob- 
serves herself writing well and is 
praised by her teacher and her par- 
ents, she probably will continue to 
write and improve her performance 
If she receives more negative feed- 
back, she probably will write as little 
as possible. 

It IS the^equential cumulative ef- 
fects of numerous learning expe- 
riences affected by various envi- 
ronmental circumstances and the 
individual's cognitive and emotional 
reactions to these learning experi- 
ences and circumstances that cause a 
persor> to make decisions to enroll m 
a certain educational program or be- 
come employed in a particular occu- 
pation Actual enrollment as a stu- 
dent or employment is not a simple 
function of preference or choice but 
IS influenced by complex environ- 
mental (eg , economic) factors, many 
of which are beyond the control of 
any single individual A change m 
learning experiences can produce a 
change in her stated educational or 
occupational preferences Changes In 
the environment can affect the type 
of learning experiences she receives 
Occupational preferences are highly 
unstable during adolescence, prob- 
ably because of the variety of learn- 
ing experiences to which young peo- 
ple are exposed. 

An abbreviated example of the gen- 
eral model applied to the case of 
Barbara" is presented m Figure 6 
As illustrated there, Barbara was born 
in the year 1944, influenced by the 
war. a new public library being built 
near her home, a charismatic Sunday 
School teacher, a boyfriend killed in 
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FIGURE 5 

General Model of Factors Affecting Occupational Selection 
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Illustrative Excerpt of Factors Affecting "Barbara's" Occupation Selection 
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Vietnam, and various social factors 
affecting women'^||ixpectations to 
have careers Also diagrammed and 
illustrated are a very few of the innu- 
merable learning experiences which 
have some effect on her educational 
and occupational selections 

Figure 7 presents another example 
of the general model applied to the 
case of Barbara This one depicts 
the development of an alternate occu- 
pational selection Genetic factors, 
early environmental factors, apd the 
early learning experiences/and an 
SOG are left intact from \he first 
example Then the diagram shows 
by three arrows that alternate instru- 
mental learning experiences may af- 
fect ultimate choice Figure 7 departs 
from Figure 6 and shows how differ- 
ent environmental factors and dif- 
ferent learning experiences and SOGs 
may affect the course of Barbara's 
career development This diagram 
also shows that environmental con- 
ditions which impinge on Barbara's 
learning experiences may sometimes 
be changed by action of the individ- 
ual, whereas others are so pervasive 
as to be impervious to an individual's 
efforts In the latter case the indi- 
vidual can regress to early stage 
or can choose a constructive com- 
promise, as IS illustrated in this ex- 
ample 

figure 8 presents another alternate 
to Barbara's environmental condi- 
tions, learning experiences, and 
SOGs In this example, Barbara's 
early experiences are once again left 
intact, for purposes of illustrating 
thai the event that followed the triple 
arrows in the diagram did not neces- 
sarily have to follow at that point 
These three figures present only 
three of many alternatives possible 
Once again, the environmental con- 
ditions impinging on Barbara's op- 
tions are illustrated In the first 
instance she succumbs to the con- 
straints imposed on her occupational 
selection by rising costs of tuilion 
for graduate school and high cost 
of loans She perceives the con- 
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straint as beyond the control of an 
individual and changes her occupa- 
tional selection from teacher to sec- 
retary In the second instance she 
decides to influence the environ- 
mental constraints' and forms an 
agency to help rernove those con- 
straints. 

It should be noted that occupational 
selections presented in these exam- 
ples constitute a lifelong process, 
not one-time choices. Although Bar- 
bara is employed as a waitress in 1974 
in Figure 6, as a general practitioner 
in a rural area in Figure 7, and as vice 
president of an employment agency 
in Figure 8, it should be recognized 
that further environmental events and 
additional learning experiences will 
occur which will undoubtedly alter 
Barbara's future educational and 
occupational activities. 

THEORETICAL PROPOSITIONS AND 
ILLUSTRATIVE HYPOTHESES 

The preceding analysis suggests a 
number of testable propositions, sev- 
eral of which follow, and a large 
number of possible testable hypoth- 
eses, only a few of which can be men- 
tioned for illustrative purposes here 

1. Factors Influencing Preferences 

As used here, an educational or oc- 
cupational preference is an evalua- 
tive self-observation generalization 
based on those learning expenences 
pertinent to any career task The prop- 
ositions that follow attempt to explain 
how these particular self-observation 
generalizations are acquired 
a. Positive influences 

Proposition IA1. An individual is 
more likely to express a preference 
for a ^course of study, an occupa- 
tion, or the tasks and conse- 
quences of a' field of work if that 
individual has been positively re- 
inforced for engaging m activities 
s/he has learned are associated 
With the successful performance of 
that course, occupation, or field 
of work 
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FIGURE 8 

illustrative Excerpt of Second Set of Alternative Factors Affecting 
^ "Barbara's" OccOpation Selection t 
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/Illustrative Hypothesis, Boys who 
are- reinforced for "their basket- 
ball performance are more likely 
to mdicate an interest in a basket- 
ball career than are those Who 
'are not so reinforced. ^ 
Why are sorne boys reinforced for 
basketball playing and othe/s are 
ndV? A boy whos6 heredity and 
nutritional environment enable . 
f|im to grow SIX feet ten inches 
taN Is more likely to be rem- 
forced by liis basketball coach 
than a boy who grows to be only 
fiva feet two inches. Genetic and 
environmental factors play a ma- 
jor .role In which learnirtg experi- 
,ences get reinforced.* 
Proposition IA2. An individual is 
more lij<ely to express a preference 
for a course of study^ an occupa- 
tion, or the* tasks and conse- 
-quenc6s of a field of work if that 
Individual has* observed a valued 
model being reinforced for engag- 

• ing m activities s/he has learned 
are associated with the successful 
performance of Uiat course, occu- 

^ pation, or field of work. 

Illustrative Hypoth^sts. Tenth 
grade girls as^gned the Btog^ 
raphy Of Flounce Nigi^mgale in 
English cla)5s wilf subsequent^y 
*• express' greater interest in nurs- 
ing tl^n will IhosB assigned 

^ Moby'Digk, 

Valued, models can be vicarious 
<^as well as real. K/lodels presented 
through literature, television, 
an^ rjio^ion pictures may well 
have as much' influence as par- 
ents, Jrel^tives. and friends for 
at least some\youngsters.-The 
^bopkg'that young people hap- 
pen to, read are a func,tio'n ot a 
^ ,punTt)er of 'environmental and 
cultural mfliTences. many.of 

" w^lch^ cannot be predicted. The 
models that young people iden- 
,tify with are .those with' which 
they happen to come in contact. 
Different cuKural ^environments 
m^ke available quite varied types 

* of models. 



• Proposition IA3. An Individual is 

♦ more likely to express a prefer- 
ence for a course ot study, an 
occupation, or the tasks and con- 
sequences of a field of work if 
that individU'arhas been consis- 
tently positively reinforced by a 
valued person who models and/or 
advocates engaging in that course, 
occupation, or field of work. 

Illustrative Hypothesis: Young 
people whose older friends and/ 
or felatlves report satisfaction 
with the benefits of>a military 
career 'are more likely to express 
interestjn joining orte of the 
military services than are those 
whose relatives have not ex- 
pressed such satisfaction 
Genetic and environmental in- 
fluences are critical in influenc- 
ing which people may qualify 

• ^or and benefit from any given 
' career. Certain physical stan- 
dards are used by the military 
services in selecting members. 
People who are too short or too 

, tall, or who were born with cer- 
tain physical handicaps woald 

* not-be eligible. Family influences 
play a big part in whether a given 
youngster comes in contact with 
people who model and/or advo- 
cate engaging in a particular 
occupation. Some people sim- 
ply never come in coritact with 
a person who, for instance, has 
chosen a military career and 
has been satisfied with it. Others 
have. .The, accident of birth there- 
foce determines to a larg.e extent 
the nature arid type of models 
with whdfTi ah individual comes 

1 In, contact. • * 

Proposition IA4. An individual is 
more likely to express a prefer- 
' ence for a course of study, an 
occupation,' or t^e tasks and con- 
^quences' in a field of worklif that 
indivlduaUhas been exposed to 
positive words and Images asso- 
ciated with that course, occupa- 
tion, field of work^'or the activi- 
ties related to It. 



Illustrative Hypothesh 3tudents 
presented with a booklet de- 
scribing. and illustrating in glam- 
orous terms a relatively unknown ' 
occupation will express more 
preference for that occupation . 
than wfll students presented with 
objective facts about it * , 
The culture in which*a young 
person grows up influerices the 
typq of words and imagers asso- 

tiated with^various occupations, 
ome cultures will glamorize 
*ine occupation, others, another 
furthermore, v\4iat constitutes 
glamour depends upon the 
. values that a particular culture 
' manifests, 
b Negative Influences ' 

Proposition IB1 An individual is 
te;ps likely to express'a preference 
for and more Iij<e1y 'to express a 
rejection of a given -course ot ^ 
study, an occupation, or the tasks 
aod consequences of a field of 
work if that individual has been 
punished anc^r has not been rein- 
forced for engaging m "activities 
s/he has learned are associated 
With successful performance of - 
that course, occupation, or field 
of work. 

Illustrative Hypothesis Children 
who have received low grades 
in mathematics are more likely 

f than are those who received 
high grades to express rejec- 
tion of any career in which 
mathematics is said to be an im- 
portant skill. 

^ Some students happen to fee 
exposed to skillful mathematics 
teachers, others are less fortu-. 
nate. Those'who are well taught 
learn rpathematics step by-step, 
master it \?y/ell, and learn to enjoy 
It Others find the tasks coming 
to them in such a sequence or 
at such a rate that they cannot 
succeed. The .differential rein- 
forqement and punishment pro- 
, vided by the schools undoubt- 
edly leads many people to reject 
occupations which entail tasKs 
they have come to hate 



Proposition IB2 , An individual is 
less likely to express e preference 
for and more likely to express a 
rejection of a given course of 
study, an occupation, or the tasks 
and consequences of a field of 
work if that individual has ob- 
served a model receive punish- 
ment and/or Jittle or no reinforce- 
ment for engaging in 'activities 
S/^e has learned are associated 
with the successful performance 
of ^at course, occupation, or field 
of woTk. ^ 
Illustrative Hypothesis College 
students vihose closest friends 
were 'trained to be teachers but 
could not find jobs upon gradu- 
ation will be more likely to re- 
ject teaching as a career than 
wjy. those whose closest friends 
wer§ trained as teachers and did 
^ find teaching jobs. 
Economic factors play a major 
role in influencing the number 
of models^which can be rein- 
forced for ^p^rtlcular kinds. of 
training activities. The change 
fr'pm a teattier shortage to a 
.teacher surplus has certainly 
influejgced the rTumber of peo- 
ple expressing a preference for 
teaphing as a career Observing 
what happens to influential mod- 
els who fail to be reinforced for 
their chxjices can probably lead 
to lowered preference for those 
' ■ same'chojces." 
Proposition IBS An individual is 
less likely to express a preference" 
for and^more likely to express a 
rejection of a given course of study, 
occupation, or the' tasks and con- 
sequences of a field of work if that 
individual has been consistently 
positively reinforced by a valued 
r person who expresses negative 
opinTons dbout th^ activities or 
persons wiio engage in that 
course, occupation, or field of 
work. 

, Illustrative Hypothesis. Ctiildfen 
of parents who ridicule or de- 
grade occupations requiring 
manual skill witl express more 
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rejection of those occupations 
than will children whose par- 
ents mal<e no> value< judgmehts 
about those occupations 
Comments directed to or even 
accidentally overheard by chil- 
dren may influence their ex- 
pressed preferences for certain 
jobs. People wilj tend to adopt 
' the opinions of those who posi- 
tively reinforce them It is also 
possible that people will tend 
to reject the opinions of those 
who punish them A number of 
other hypotFTeses could be gen- 
erated on the interactions of 
reinforcement and/or punish- 
ment, the opinions of the rein- 
' forcing agent or the- punishing 
agent, and the resulting ppin- 
ions of the recipient. The per- 
sons with whom one happens 
to come in ccfhtact can therefore 
have a great influence upon the 
expressed prefg^ces for vari- 
ous bccupatloKs?"'^ * 
Propcf^ition IB4. An individual is 
less likely to express a pr-eference 
for and more likely to express a re- 
jection of a given course of study, 
an occupation, or the tasks and 
consequences of alfield of work 
if that individual hat8;been 'exposed 
to negative Words and Images as- 
sociated with thatxourse/occu- 
pation, field of v\^orlf, or activities 
related to it. « »* 

Illustrative Hypothesis. Chlld'ren 
seeing a mbtion picture depict- 
ing police officers as corrupt 
will be more likely to reject law 
enforcement as a pareer than* 
will those seeing a factual docu- 
mentary on law enforcement. 
The nnotio^ picture and televi- 
, sion media probably play an 
' influential role in generating 
preferences for or, against vari- 
ous occupations, It could be 
speculated that the current pop- 
ularity of merficgl and legal train- 
ing owes a good deal fo the in- 
fluence pf Marcus, Welby and 
Perry Mason. 



2. Factors Influencing COM Skills 

COM Skills are a Subset of-task ap- 
proach skills pertinW to occupational 
and educational de^s^sion making. 
Propositions in this se^too atterppt 
to explain how these particular skills 
are acquired, 
a. Positi\^e Iniluences 

Proposition IIAh An individual is 
more likely to learn the cognitive 
and performance skills and emo- 
tional responses necessary for 
career planning, self-observing, 
go3l setting, and information seek- 
ing if that inclividual has been posi- 
tively reinforced for those re- 
sponses. 
Illustrative Hypothesis: High 
school students who are given a 
structured course in decision- 
making sliiiJs and whose efforts 
in that/course are consistently 
rewei/ded an>l never punished 
will TDe more likely to apply 
thosexjecisio 
future 
will thos^ 
not receivin 
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making skills in 
problems than 
school students 
ch a coAJrse. 
Educational institutions may weM 
be able to influence the degree 
• to which people learn how to 
take control of their own career 
decisions. ^CDM is' hot exclu- 
sively the result of eyents hap- 
pening to an individual but can 
also be Shaped by an individual's 
own actions. But people need 
to k-now wha-t kind of actions 
are likely to have-some positive 
results for them. Systematic in- 
struction can be designed to. 
increase the probability that 
people can formulate and select 
intelligently from options that 
are presented to them or that 
they^may have designed for 
themselves. 
Proposition IIA2. An individual is 
more likely to, learn the cagnitive 
and performance skills and emo- 
tional responses necessary for 
career planning, self-observing, 
goal setting, and^information seek- 
ing^if that individual has observed 
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real or vicarious models engaged 
m effective career decision-mak- 
ing strategies. 
Illustrative Hypothesis. Students 
who observe a COM film ih which 
the models are depicted as be- 
ing positively reinforced for 
engaging m the process will be 
more ifkely to engage in a simi- 
lar process than will students 
not exposed to the same film 
Films, books, television pro- 
grams, as well as the opportu- 
nity to observe real people wisely 
engaging in decision-making ac- 
tivities can probably have a great 
deal of influence on the extent 
to which young people'l^ill learn" 
decision-makihg skills them- 
selves. Experiments 'can be de- 
signed *lo determine the exa(?t 
nature of such experiences that 
will make them most effective 
for youngsters of various back- 
grounds contemplating deci- 
sions of various types. 
Proposition IIA3 An indrndual rs 
more likely to learn the cognitive 
and performance skills and emo- 
tional responses necessary for 
career planning, self-observing, 
goal setting, and information seek- 
ing if that individual has access to 
people and other resources with 
the necessary information. 
Illustrative Hypothesis, Students 
in schools that set up procedures 
for making career information 
easily accessible in meaningful 
ways will develop ,CDM skills to 
a greater extent than will stu- 
dents m schools not providing 
such opportunities. 
Educational environments which 
provide needed CDM resources , 
• will probably produce superior 
decision-making skills. How- 
ever, the resources need to be 
tailored to the entering skill level 
of the students and need to be 
made interesting and pertinent 
to the target population^. Re- 
sources include not merely de- ■ 
scriptive materials about oc- 
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cupations, but simulated job 
expjeriences, opportuaities to 
talk with people engaged in 
various occupations, and even 
opportunities to work for short 
periods of time inclose associa- 
tion with people in various occu- 
pations 

b Negative Influences « 
Proposition IIB1. An individual is 
less likely to learn the cognitive 
and performance skills and emo- 
tional responses necessary for 
career planning, self-observing, 
goal setting, and information seek- 
ing if that individual has been 
punished.,or not reinforced for 
such behaviors. 
^ Illustrative Hypothesis. Children 
who^e attempts to make their 
own plans and decisions, are 
consistently punished or over- 
ruled will develop less effective 
decision-making skills than will 
^children whose planning efforts 
are reinforced or merely ignored 
Planning can be made an aver- 
sive activity When plans are 
constantly upset by unforeseen 
factors, a youngster may develop 
the view that such planning is 
useless since events are out of 
her or his control •» 
Proposition IIB2. An individual is 
less likely to learn the cognitive 
and performance skills and emo- 
tional responses necessary for 
career planning, self-observing, 
^ goal setting, and information seek- 
ing if that individual has observed 
real or vicarious models receive 
punishment and/or little or no re- 
inforcemeni for attempting to 'en- 
gage in CDM activities. 
Illustrative Hypothesis. Y6ung 
people who associate with peers 
who reject the usefulness of ca- 
reer planning and believe that 
fate will make their plans ^re 
less likely to develop decision- 
making skills than are those stu- 
dents who associate with peers 
who are committed-^to the notioh 
of career planning and the pos- 
sibility of self-control. 
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^ Peer influences play a big part 
in young peoples lives, but 
peers are only one of the sets^ 
of models. Parents whose own* 
careers have been frustrated 
may explicitly ir implicitly model 
the view that fate controls one's 
life and that therefore the best 
course of action is to take the 
most expedient step at the mo- 

. ment rather than plan for the 
future 

Proposition UB3, An individual is 
less likely to learn the cognitive 
and performance skills and emo- 
tional responses necessary for 
caceer planning, self-observing, 
goal setting, and information seek- 
ing if that individual has little or 
no access to people and other re- 
sources with the necessary infor- 
mation 

lliu^trative Hypothesis Persons 
denied access to simulated vo- 
cational problem-solving mate- 
rials will engage in less career 
exploration than will individ- 
uals who are given successively 
greater exposure to such simu- 
lated vocational problem-solv- 
- ing materials 

Critical experiences maybe de- 
signed to encourage active ca- 
reer exploration. The fact that 
many young people have no idea 
what It IS they want to do is 
probably due to the fact that 
they have had such limited ex- 
perience with actual occupa- 
tional activities. The more activi- 
ties that can be pr*ovided for 
them related to occupations, 
the more they can learn what it 
IS they like and dislike, what they 
can and cannot do. wljat they 
waat\to learn and do not want 
to learn, and what they want to 
find out about next. 

3. Factors^lnfluencing Entry Behaviors 
into Educational or Occupational 
Alternatives 

Given the acquisition of preferences, 
emotional responses, and cognitive 
and perforrnance skHls through vari- 



ous learning experiences, the proposi- 
tions in this section attempt to explain 
some factors that account for Ujg 
actual entry behaviors into occupa- 
tions, training programs, or educa- 
tionral courses of study." 
a. Positive Influences 

Proposition IIIA1, An individual is 
more likely to take actions leading 
to enrollment In a given course or 
employment in a given occupa- 
'tion or'field of work if that indi- 
vidual has recently expressed a 
preference for that course, occu- 
pation, or field of work. 
Illustrative Hypothesis' People 
entering plumbing apprentice- 
ships will express a higher de- 
gree of interest in plumbing than 
will people of the same age and 
sex who are not^entenng plumb- 
ing apprenticeships. 
Perhaps it seems obvious that 
expressed preference and actual 
fchoice will correspond How- 
ever. It is necessary to make ex- 
plicit tba^ the preferences gen- 
-lerated through the procedures 
described onder the first set of 
propositions above will be re- 
flected in the actual actions 
taken by those individgals How- 
ever, preferences change over 
time. It IS only the most recently 
expressed preference that is of 
concern at the time action is 
taken. This means^that recent 
) events can have an influence 
upon both preferences and ac- 
tions Educational and occupa- 
tional preferences are not estab- 
lished at an early age to ren^ain 
stable ever after. The process 
IS In a constant state of flux as 
a result^ of constantly ^changing 
circumstances. 
Proposition IIIA2. An individual is 
more likely to take actions leading 
to enrollment in a gkven course 
or employment in a given occupa- 
tion or field of work if that indl- 
viclual has been exposed to learn- 
ina and employment opportunities 
. m that course, occupation, or field 
of work. 
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Illustrative Hypothesis Commu- 
nities that make available train-* 
ing opportunities as dental hy- 
gienists will firvd more people 
in that community seeking to 
become dental hygienists than 
will occur in equivalent commu- 
nities w^\ere such training is not 
made available 

Again ft may seem obvious that 
the number of trainees will vary^,^_ e 

as a function of^the number of Mion or field of work if that 
training opportunities But it 
IS ilnportant to note that the eco- 
nomic environment plays a big" 
role in what occupations people 
actually enter'. Individuals make 
choices among concrete alter- 
natives Actual entry into occu- 
pations or training is a function 
of available opportunities and 
the chance to find out about 
those opportunities. 
Proposition IIIA3 An individual is 
'more hkely to take actions^ lead- 
ing to enrollment m a given course 
or employment m a given occu- 
pation or field of work if that indi- 
vidual's learned skills matchr the 
educational and or occupational 
requirements 
Illustrative Hypothesis Individ- 
uals who become professional 
football players will have su- 
perior muscular coordination 
compared to that of individuals 
who become accountants. 
Tracfitional aptitude tests have 
not provided clear distinctions 
between people entering vari- 
ous occupations However, for 
ceriam occupations there are 
learned skills (cognitive and per- 
formance) which are necessary, 
^ skills which are not measured 
by traditional aptitude tests. In- 
dividuals who have learned to 
^pound a nail without bendir>g it 
are .more likely to become car- 
penters than are individuals who 
constantly bend {\\e nail after it 
is half way into the wood. Oppor- 
, tunities vary for people to learn 
these skills depending upon the 



^ training opportunities they have 
had, the models they have been 
exposed to, the cultures that 
they have grown up m, and the 
genetic factors thatjtenable them 
to learn the skills 
/yegaf/Ve Influences 
Proposition IIIB1. An individual is 
less likely to take actions leading 
to enrollment in a given course or 
employment in a given occupa- 

in- 

dividual finds that the cost of 
preparation for that occupation 
IS excessive m relation to future 
economic, social, and personal 
rewards 

Illustrative Hypothesis, Providing 
scholarship money for medical 
school training will increase the 
probability that poverty level st^i- 
dents who are otherwise quali- 
fied will enter medical training. 
The cost-benefit ratio of prepa- 
ration to reward in occupations 
' plays an important part in which 
individuals.aspire to which occu- 
* pations. By reducing the cost of 
preparation^or by increasing the 
rewards associated with suc- 
cessful performance, a society 
pan alter the nature and number 
of individuals entering eaCti 
occupation. 
Proposition lflB2 An individual is 
less likely to take actions leading 
to enrollment m a given course 
or employment in a given occu- 
pation or field of work if that in- 
dividual IS denied access to the 
minimum resources necessary for 
entering that occupation or field 
of work. ^ 
Illustrative Hypothesis. Among 
students aspiring to become air- 
line pjlo'ts, those who are ad- 
' mitted to Air Force or Navy pifot 
training programs will be more 
likely to enter the occupation 
of airline pilot than will those 
who are denied access to such 
training 

A society can make^training for 
certain occupations so expen- 
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sive that relatively few people 
can afford it unless they sotVie- 
^how are gwen special access 
''pajd for by the socjely at large 
Pilot training is just one example 

IMPLICATIONS FOR COUNSEIoRS 
AND CLIENTS 

To the extent that this social learning 
view of career selection bears some 
resemblance to reality (and the de- 
gree to which that resemblance can 
be checked through empirical re- 
search), some important views and 
im^fcations emerge for counselors* 
and clients 

1 Occupational placement is the 
result of a complex interaction of 
genetic components, environmental 
events and conditions, and learning 
experiences wtYiciD result m the de- 
velopment of various task approach 
skills 

2 Career selection is a mutual pro- 
cess influenced not only by decisions 
made by each individual involved but 
also by social forces which affect 
occupational availability and require- 
men'te People sjelect. and are selected 
by. occupations 

*3 Career selection is a lifelong pro- 
cess It does not take place at one 
.point m time, but is shaped by events 
and decisions that occur from infancy 
through the retirement years 

4" Career selection i^ caused, not 
accidental, but the interaction of 
causal events is so complex that the 
prediction of occupational selection 
for any one individual isvirtually im- 
possible w^ith any degree of certainty 
5 Career indecision is due to the 
unsatisfactory nature or an insuffi- 
cient number of career-relevant learn* 
ing experiences or to^ the fact that 
the person has not yet learned and 
applied a systerftatic way of making 
career decisions Indecision is a 
natural result of not yet having had 
certain learning experiences An un- 
decided perSSin has no reason to feel 
guttty or inadequate 



6 Career counseling is not merely 
a process of matching existing per- 
sonal characteristics with existing 
jOb Characteristics, but instead is a 
process of opening uq new learning 
experiences and motivating a client 
to initiate career-relevant explora- 
tory activities 

7 The responsibilities of a care^ 
counselor, then, are as follows 

(1) To help the client learn a rational 
sequence of career decision-making 
skills, 

(2f To help the client arrange an 
appropriate sequence of career-rele- 
vant exploratory learning experi- 
ences, and 

(3) To teach the client how to eval- 
uate the personal consequences of 
tl^ose learning experiences 
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O^BSTRACT 

Four hundred and thirty-eight men 
ahd women college students partici- 
pated in a longitudinal study exam- 
ining the causal relationships among 
careeiv progress, sex-role attitudes. 
. and cognitive styles. Students com- 
pteted the battery of instruments 
' twice, at five or twelve-month in- 
" tervals, Th^ direction of causality 
dmong the variables was investi- 
gated by cross-lagged' paneJ com- 
. parison§. The major findings sug- 
gested that changes in sex-role 
attitudes and cognitive styles yvere 
a result of changes in career decision 
variables. Sex-role attitude changes 
followed cognitive style, changes, 
and attitudes concerning the ascrip- 
tion of sex-role appropriate behavior 
to others produced changes m the 
' self-ascription of sex-role, attitudes. 
The implications of thesje" results are 
discussed in terms, ot Super and 
Tiedeman s theories of career imple- 
mentation. 



M^ny authors have discussed the 
negative, restrictive impact of tradi- 
tional sex-role socialization both for 
women (Hornllr. 1972. Hoffman, 1972) 



and for men (Pleck & Sawyer. 1974. 
David & Brannon, 1976). Career de- 
cision making and career-related 
choices are excellent examples of'' 
areas in which differential socializa- 
tion has restricted ^e range of al- 
ternatives from which either sex can 
choose. Interest in this area has led 
t9 attempts^ to differentiate between 
career-oriented and homemaker-orl- 
ented'women (e.g.. Richardson. 1975. 
Tinsley & Faunae, in p/ess)rOr among 
career-oriented women, those wha 
choose traditional (female dominated)' 
careers versus those who choose non- 
traditiona^l careers (Nagely. 1971 . Wol- 
kon. 1972. Tangr^. 1972. Almquist. 
1974. and Grawfprd. 1978) In a rlecent 
study by the present investigjalors 
^Harren. Kass. Tinsley, & Moreland. 
in press), we found that stuQients' 
choices of gender-dominant 
pations were influenced by g^|" 
the self-ascription of femijiine 
ties, attitudes towaxd the se;||-role 
appropriate behavior of womenl and 
degree o*f cognitive complexly in 
judging female-dominant occupa- 
tions. 

These studies reflect the assump- 
tions that sex-role social iza^ion-^ 
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causes men and women to hold dif- 
ferent self views, which in turn medi- 
ates the development of somewhat dif 
ferent cognitive characteristics ^The 
sex-role related aspects of the self- 
concept and these cognitive dimen- 
sions are then assumed to causally 
influence the process and outcome 
of career-related decision making.^ 

Such an ordering of causaJ influ- 
ences actually has a very strong base 
m career development theory For 
example, Super and his associates 
(Super, 1953, Super. Starishevsky. 
Matlin. & Jordaan. 1963) have pro- 
posed that ones vocational self-con- 
cept IS implemented through one s 
occupational roles A good career 
selection is based upon the choice 
of a career which allows lor the ex- 
pression of the self Such selection 
must be predicated on the existence 
of a well crystallized self-concept 
prior to tjie execution of a particular 
decision 

There is considerable empirical 
support for such ^a causal ordering 
Barrett and Tinsley (1977a. 1977b) 
have reported evidence that the fre- 
quently documented relationship be- 
tween self-estee*m and the ability to 
make a satisfying vocational decision 
-IS. in fact, a function of the vocational 
self-concept crystallization of the 
inldtvidual Horner (1972) has shown 
t|iat women experience fear of* suc- 
cess when their t^haviors are dis- 
crepant with their standards of femi- 
ninity Bem and her associates (Bem. 
1974. Bem & Lenny. 1976. Bem. 1977) 
have shown that sex-role related as- 
pects of men and women s, self-con- 
cepts influence their behavior in a 
number of labtoratory tasks Bodden 
and Klein (f972) have demonstrated 
that cognitively complex individuals 
were more likely to make occupational 
choices consistent with their Holland 
codes than were coghitiyely simplistic 
persons In our own work (Harren, 
Kass. Tinsley. & Moreland, 1978). we 
recently concluded that students' 
satisfaction with their choice of aca- 
" demic major was influenced by their 



progress in the decision-makmg pro- 
cess This progre$s was. in lurn, 
causally influenced by their decision- 
making styles, sex-role related as- 
pects of their self-concepts, and their 
attitudes about the sex-role appropri- 
ate behavior of men and women 

While these studies support the 
causal ordering described . above, 
they fail to be adequate tests of 
causality Be.cause their measures 
were collected from the subjects at 
only one point m time, their conclu- I 
sions are based on essentially corr.e- 
lational analyses Harren et al (1978. 
in press), for example, used a path 
analysis procedure which required 
that an assumption aboi^t the direc- 
tion of causality .among the variables 
be made based upon prior thepreti- 
cal considerations An additional 
assumption of path analysis is that 
any variable outside the investigated 
variables is not correlated with more 
than one of the path variables This 
eliminates by prior assumption the 
third variable hyfiothesis which 
plagues correlational studies 

By analyzing data collected from 
the same subjects at two different 
points in time, one can make much 
more definitive statements about 
causality The present study repre- 
sents a re examination of the causal 
relationships among these variables 
provided by a longitudinal desrgn 
employing a cross-lagged panel anal- 
ysis Cross-lagged panel analysis 
(CLPA) requires neither an a pnon 
assumption of directionality, nor the 
assumptiort of no third variable effect 
CLPA IS. in fact, a test for the third 
variable effect or spuriousness' 
(Kenny. 1975) If the hypothesis of 
a spurious Relationship between two 
variables is rejected by CLPw^. then 
the dire^hoji of causality can be de- 
termined a pbsX^non by the differ- 
ences in size o?^he cross-lagged 
correlations. In this rft&^^ner, .CLPA 
V provides a mor6 empiricaifexaipina- 
tion of the causal relationships among 
sex-role attitudes, cognitive style, 
the decision-making process, and 
choosing a college major. 
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Two major questions concerning 
* the causalVelationships among these 
variables are addressed in this paper 
First, do the sex-role attitude and 
cognitive style variables influence 
qgM^er progress (i e , career decision- 
making process and choice of major) 
as most theorists and researchers 
assume'^ Or is it the case that the 
relationship often found between^ 
these two variables is due to the influ- 
ence of changes in one's career prog- 
ress on one's sex-role attitudes and 
cognitive style'' The second question 
involves the causal ordering between 
the sex-role attitudes and cognitive 
style Do sex-role attitudes influence 
cognitive style or does one's cogni- 
tive style affect ones sex-role atti- 
tude'? 

METHOD 
Subjects 

A random sample of undergraduates 
at Southern Illinois University at^Car- 
bondale was sent a letter in the falh 
of 1976 The letter explained the re- 
search project and, offered $3 00" for 
participation This is the sample 
Harren et al. (1978) used for their 
path analysis Five months later, ir> 
the spring of 1977. anothe.r letter 
was sent to the seniors who had 
completed the time one instruments. 
This letter explained the desirability 
of a second testing' session and again 
offered $3 00 for participation In the 
fall of 1977, a second letter was sent 
to the original Irishmen, sophomores, 
and juniors who had participated in 
the original testing session The letter 
ws Similar to that sent to the seniors 
except It now offered $5 00 for a re- 
turn test session Also m the fall Oi 
1977. a new sample of freshmen were 
contacted for an initial testinrg session 
usmg the same procedure These 
freshmen were recontacted for a sec- 
ond session five months later in the 
spring The distribution by class and 
sex for all four class 'levels at both 
testing sessions is given in Table 1 
The overall rate^of participation was 
64% 



Instrumentation 

Students were partitioned into three 
groups on the decisional status (DS) 
criterion variable Group I consisted 
of those individuals who had not made 
a choice of major Group- II included 
those individuals who had made a 
choice of major but who indicated 
they were not highly satisfied with 
the choice (le. rated their satisfac- 
tion as * 6 on a 9-point scale where 
1 = Dissatisfied and 9 - Satisfied). 
Group III consisted of tjiose individ- 
uals who had made a choice of major 
and who also indicated that they were 
highly satisfied (i e rated satisfac- 
tion as ^ on a 9-point scale) -with 
their choice 

The Assessment of Career Deci-;^ 
sion Making (ACDM) was developed 
by Harren (1976) to measure progress 
through Tiedeman and O'Har^'s (1963) 
model of career decision making 
Forty Items of the ACDM concern the 
college student's progress in decid- 
ing on 9 college major and reflect 
progress through Tiedeman and 
O'Hara's first four psychological 
stages exploration, crystallization, 
choice, and clarification The instru- 
merit yields a decision-making ^ask 
score which indicates iprogress to- 
wards choosing a major (DMTM) The 
higher the score, the further the stu- 
dent has progressed The four mea- 
sures of cognitive styles usedyin the 
present investigation include three 
decision-making style scales from the 
ACDM These three scales measure 
a rational (DMS-R), intuitive (DMS-I), 
and dependent (DMS-D) career deci- 
sion-making style The fourth mea- 
sure of cognitive style was the Cog- 
nitive Differentiation Grid (CDG: Bod- 
den, 1970), which cmeasures the ex- 
tent to which an individual uses a 
range of cognitive constructs in rat- 
ing various occupations. 

Sex-cole attitudes were measured 
usmg three instruments yielding five 
scale scores^ The Bern Sex Role In- 
ventory (BSRI, Bem, 1974) measures 
three self-attributed sex-role char- 
acteristics, femininity (BSRI-F), mas- 
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culmity (BSRI-M). and androgyny 
Bern s androgyny scale was not used 
m the present research because the 
nature of its scoring system suggests, 
that It woulcj have a curvilinear rela- 
tionship With the other variables m 
this study. As an alternat'ive to Bern s 
t score androgyny scale. Harren et al 
developed an androgyny scale (fiSR!- 
X) based on the subjects high and 
low scores on the masculine and 
V fehninine scales (4 high on both 
scales. 3 high on sex appropriate 
scale. low on sex inappropriate scale. 
2 low on sex appropriate scale, 
high on sex inappropriate scale. 1 
low on both scales) Two instruments 
were' used to measure subjects atti- 
tudes toward the sex-role appropri- 
ate behavior of men and women the 
Attitudes To\fi/ards Women Scale 
(AWS. Spence & Helmreich. 1972, 
Spence. Helmrqich. & Stapp. \973) 
and the Attitudes'^owards Masuchne- 
Transcendence Scale (AMIS*. More- 
land & Van Tuinan, 1976) For a more 
complete description of the instru- 
ments and rationale fdr their* inclu- 
sion in the original battery of tests, 
see Harren et al (i978) 

, Analysis 

Among the first developers of CLPA 
as a method for inferring causal pat- 
terns in longitudinal data were Camp- 



bell and Stanley (f973) A more com- 
plete presentation can be found in 
Kenny (1975), while Calsyn (1976) 
presents useful guidelines for inter- 
preting CLPA Figure 1 depicts a cross- 
lagged panel diagram The correla- 
tions r^.x, and r^,^, are called 
autocorrelations and represent the 
test retest correlations for x and y.. 
respectively The correJations r^.v. 
and r^iv, are called synchronous 
correlations CLPA assumes that xi 
and yi are measured at the^'same time 
(time 1) and x^ and y^ are measured 
at the same time (time 2) This is called 
the assumption of synchronicity 
(KenneyT 1 975) Correlations r^,,, 
and rv,,, are the^cross-lagged cor- 
relations When certain assumptions 
concerning the synchronous correla- 
tions are met. the difference between 
the cross-lagged correlations will in- 
dicate whether x is causally predom- 
inant over y or y IS causally predomi- 
nant' over X The term causally 
predominant indicates that the one 
variable is a stronger cause of the 
other variable, although the other 
variable may be exerting a weaker 
reciprocal causal influence In rare 
instances where the cross-lags would 
be nearjy equal but opposite in sign, 
then the existence of a negative feed- 
back system is probably the appro- 
priate interpretation (Calsyn, 1976) 



TABLE 1 

A Class by Sex Distribution of Subjects Who Returned and Those 
Who Did Not Return for a Fo!low-Up Test Session 

Males Females 



Lag Time ^ Return 



Class 


(Months) 




NR 


R 


NR 


Rate 


Freshmen 


5 


44{1)" 


. 15 


55(0) 


16 


76 


Freshmen 


12 


57(0) 


31 


59(1) 


24 


68 


Sophomores 


12 


39(1) 


28 


51(3) 


27 


62 


Juniors 


12 


46(3) 


' 24 


44(1) 


22 


66 


Seniors, 


. 5 


27(0) 


39 


25(1) 


32 


i 42 


Total 




213(5) 


J37 


234(6) 


121 


. 63 



■* R return. MR - did not r'eturn 

' Number in parentheses iS the number of subjects who returned but were subsequently 
dropped due to incomplete clata 



As an increase in x causes increases 
in y an increase in y also causes 
decreases in x negative feedback 
system promotes stability in the 
system 

Causal inference from (ilPA Criti- 
<cally asSgmes that the causal deter- 
minants of X and y remain the same 
at both time 1 and time 2 Kenny (1975) 
refers to thjA as the assumption of 
stationarity (Inly »f the assumption 
of stattonarity and synchronicity are 
met do differences between the cross- 
lagged correlations rul^ out the 
third-variable ^ffect and indicate a 
causal relationship Significant dif- 
ferences (p 05) between cross- 
lagged correlations were determined 
by a Pearson-Filon z-test for corre- 
lated correlations (Kenny. Note 1) 
JCenny and Calsyn discuss a number 
of ways to test whether the assump- 
tions of synchronicity and station- 
arity have been met For a thorough 
discussion, the reader is referred to 
this work Only the cross-lag panels 
meeting both of these assumptions 
are discussed in this paper 



CLPA IS designed to err in the direc- 
tion of failing to find a significant 
causal effect (Type II error) rather 
than mistakenly identifying spurious- 
ness as a causal effe'ct (Type I error) 
Consequentlj|both Kenny (1975) and 
Calsyn (1 976precommended using 
different samples and different time 
lags In the present analysis, we 
have chosen to examine the data by* 
analyzing each class sample with the 
d&ta for the sexes combined For these 
five independent analyses, the effect 
for sex was statistically partialled out 
Some of th^ sample sizes were too 
small (N #24) to perform a CLPA in- 
dividually on each class and gender 
Each independent panel analysis 
examined all possible panel pairs 
(55) from the eleven variables under 
investigation 

As in any longitudinal st^dy, attri- 
tion IS a problem Both Kenny (1975) 
and Calsyn (1976) recommend using 
only those subjects who have com- 
plete data at both times While this 
restricts the generalizability of the 
reported results* an estimation can 



FIGURE 1 

Cross-lagged Panel Correlations for the Vanabte x and y 
at Two Different Points in Time 
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be made of how similar the students 
who completed the project are to 
those students not completing the 
project At each class level and for 
each sex. a' t-test {pi=,.05) compari- 
son was nnade of the differences be- 
tween the returners and non-returners 
on all eleven variables. Significant" 
differences were observed in only 
lyvo of 110 comparisons, thus indi- 
cating that the .attrition can be as- 
sumed to be due to factors other than 
the variables under investigation in 
this study " ^ 

RESULTS 

Table 2 summarizes the parfel com- 
parisons in those .samples meeting 
the assumption of slationarity Only 
the sophomore sample (N = 86) failed 
to meet this assumption The left-hand 
column of Table 2 denotes the pair 
of variables found to have a causal 
relationship The direction of the 
causal effect is represented by the 
direction of the arrows which appear 
in the column beneath the sample(s)» 
in which that cross-lag comparison 
was statistically significant An arrow 
with a plus sign indicates a simple 
causal relationship Thus, m Table 2 
the first arrow under the freshman 
(5 mo ) indicates that for this sample, 
an increase jn progress through the 
decision ma process towards 
choosing a cottege major causes an 
increase in the endorsement of BSRI ^ 
masculine qualities An arrow with 
a minus sign shows that an increase 
m one variable causes a decrease in 
the other variable For example, the 
first negative arrow under freshmen 
who were Ifested at a 12 month inter-" 
^^^^rgnifies that an increase in deci- 
sional status from time 1 to time 2 
causes^ a decrease in the use of the 
intuitive decision making style at lime 
2 The double arrow under the fresh- 
man sample (5 mo ) represents a nega- 
tive feedback situation An increase 
in the decision making process causes 
an increase in the self-ascriplion as 
androgynous However, the negative 
Sign arrow signifies that this increase 



in androgynous characteristics from 
time.1 to time 2 causes a correspond- 
ing decrease in the decisiort making 
process. Thus, there is a tendency 
for these two variables to reach a 
state of dynamic equihbrium 

Question one concerns the direc- 
tion of causality between decision- 
making progress and sex-role atti- 
tudes, and cognitive styles In Table 
2 there are four instances of the causal 
predominance of decision-making 
progress influencing sex role anfl 
cognitive style rather than vice versa, 
and only one instance when a sex- 
role attitude influences the decision- 
making process For juniors, making 
a satisfying choice of major (DS) 
causes an increase in their endorse- 
ment of sex-role self-concept as mas- 
culine (SRl-M) In a similar manner, 
progressing through the psychologi- 
cal decision-making stages (DMT-M) 
IS also causally related to an increase 
in thfe self-ascnption of masculinity 
for freshmen (5 mo ) Moreover, we 
find that progression through the 
decision-makmg process also pro- 
duces an increase in^the androgynous 
(BSR^-X) self-concepf for the five- 
month freshman sarpple. However, as 
stated previously, this particular rela- 
tionship also shows the reciprocal 
causal effect of increases of androg- 
yny decreasing the decision-making 
process These findings suggest, for 
freshmen and somewhat for juniors, 
that decision-ma4<Jng progress and 
making satisfying choices of major 
causes students to change '^heir view 
of themselves to include a stronger 
empha^s on androgynous or instru- 
mental qualities. See Moreland, Gu- 
lanick,^ Montague. & Harden (1978) 
for an interpretation of masculinity 
(BSRl-M) as instrumentality. With the 
exception of one bidirectional causal 
relationship, changes in the sex-role 
related asp^t of the self-concept 
appear to tWIbw decisive action, 
rather than decisfve action being the 
result of changes in self-concept. 
We can reach similar conclusions 
about the causal relationships be- 
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TABLE 2 

Summary of Patterns of Causal Predominaqge Where Effects^of Gender 
Are Statistically Partialled Out 



.Variables Related 
Causally' 



Samples 

Freshmen Freshmen Juniors 

5 months 12 months 12 months* 

N = 98 N ~ 115 N = 86 



Seniors 
5 months 
N - 51 



OS. BSRI'M' 
DS. DMS-I 
DMTM. BSRI-M 

DMTM. BSRI-X 

DMTM. DMS-I 
AWS. DMS-R 
BSRI-F. DMS-I 
BSRI-X. DMS-I 
DMS'R. DMS-I 
AWS. BSR^F 
AWS, AMTS . 



Note Only the panel comparisons with statistically different cross-lagged correlations 
are included ' * * i 

■DS - decisional status. DMTM decision-making task for college major. AWS - At- 
titudes Toward Women Scale. AMTS = Attitudes Toward" Masculine Transcendency. 
BSRI-M Bem Sex Role Inventory masculine scale. BSRI-F - femininity scale. BSRI-X 
- androgyny scale. DMS-R - rational decision-inaking style, DMS-I intuitive deci 
sion-making style. DMS-D ^ dependent decision-making style. ^ 

J These crx)ss lagged differentials were statistically significant only after the two van- 
*ables were adjusted for changes in reliability (see Kenny. Note 1) 



tween decisional status, decision- 
making progress, and the cognitive 
variables. For freshmen (12 mo.), in- 
creases in both decisional status and 
decision-making process cause de- 
creases in utilization of the mtuitive 
decision-making style (DMS-I). 

Question two concerned the direc- 
tion of causality between sex-role 
attitudes and cognitive styles. Two 
of these unidirectional causal rela- ' 
tionships suggest the predominant 
influence of cognitive styles on sex- 
role attitudes rather than vice versa. 
Surprisingly, for freshmen (12 fno.) 
hn increase in the rational decision- 
making style (DMS-R) produces de- 
creases in liberal attitudes Howard's 
sex'^ole appropriate behavior of 
women (AWS) This finding was un- 



expected and there is no immediate 
apparent interpretation for it. Not 
so surprising is the finding that an 
increase in the intuitive decision- 
making style leads to an increase m 
endorsement of feminine qualities 
(BS5l-F)Mor ^resUmen (5 mo.). In 
only one instance do we see the ef 
feet of a sex-role attitude on cogni- 
tive ^tyle For seniors, §n increase 
in their self perception as androgy 
nous causes a decrease in their mtui 
tive decision-making style score 

The third set of findings is not re- 
lated to our original hypotheses 
When examininfbthe intrarelation 
ships among the sex-role attitudes 
and cognitive styles we find some 
interesting results. An increase m 
rational decision-making style cause 
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a decrease m the mjuilive style Sur- 
p>isin9ly we find that for ireshmen 
(5 mo ) an increase in liberal attitudes 
concerning the sex-role .appropriate 
behavior for women (AWS) increases 
, l*^e self-ascriptibn of femininity 
(BSRI-F) Thus, self-ascnption follows 
other-ascnption and not vice versa 
Moreover, for both freshmen (5 mo) 
and seniors, increases in liberal atti- 
tudes concernmg sex-role behavior 
appropriate for women causes an 
increase m liberal attitudes towards 
sex-role apropriate behavior for men 

DISCUSSION ^ 

Harren. et al (1978) reported that stu- 
dents satisfaction with their choice 
of an academic major was apparently 
caused by their progress in the deci- 
sion-making process. This, in turn, 
was causally influenced by their deci- 
sion-making styles, sex-role related 
aspects of their self-concepts, and 
their attitudes about the sex-role' ap- 
propnate behavior of men and women 
' They concluded that tjieir 'findings 
were consistent witj^ fhe bulk of the 
sex-rote and coOnselmg literature, 
which suggests that as one s atti- 
tudes, self-concept, ahd decision- 
making styles become more dif- 
ferentiated, onl IS able to better 
/ progress throuor the stages of the 

" decision-makingjZprocess and experj- 
ence greater satisfaction with one's 

— ^decisions The results of the present 
sht^^y, based on data collected from 
i^he same subjects at two different 
points of time, raise serious doubts 
about the earlier conclusions , of 
Harren. et al (1978) 

In our earlier work, we used cro^s- 
sectional data to test an a pr/on de- 
termined mo'del of causal relation- 
ships between §ex-rote self-concept 
and attitudinal measures, ♦cognitive 
style variables.' and decision-nnaking 
process and outcome indicators In 
the presenfstudy. the use of CLPA 
on longitudinally obtained data has 
served to highlight the limitations of 
cross-sectio^nal data in determining 
causal relationships CLPA involves 



no a pnon postulatiOns of causal ef- 
fects. Theory is required only for the 
selection of the variables which ^ 
to be studied Short of laboratory con- 
trolled, experimental designs. CLPA 
IS the most definitive approach avail- 
able for determining causality among 
a set of variables In fact. CLPA de- 
signs may have more external validity 
than laboratory experiments (Calsyn. 
1976) 

Inspection of Table 2 reveals only 
one instance in which a particular 
comparison is significant for more 
than one year level There are prob- 
ably a number of factors which are 
responsible for the lack of replica- 
tion of particular panel combinations 
As we mentioned in the method sec- 
tion. CLPA IS not a statistically power- 
ful test Thus, a true causal relation- 
ship may not be detected and the 
hypothesis of spuriousness will be 
accepted. The^ck of replication may 
also reflect true developmental 
charges in the manner in which the 
variables under investigation influ- 
ence each other Thus, inferences 
attributed to on^ or more of these 
samples may or may not gene^^lize 
to mare than one year level ^he 
reader should interpret our conclu- 
sions as tentative research hypothe- 
ses and evaluate the following dis- 
cussion on Its heuristic merits 

The finding regarding the causal 
predominance of the career decision 
variables over the attitudinal and cog- 
nitive variables have some important 
implications for ,th,eories of career 
decision making and the career 
counselor For example. Super, Star- 
ishevsky, Malfin. and. Jordaan (1963) 
postulate that persons' career de; 
velopment depends on the degree to 
which their self-cancept is formed and 
crystallized Persons' vocational self- 
concepts are implemented through 
their occupational decisions thus, 
the resolution of developmental tasks 
presupposes a crystallized self-con- 
cept. sUch that the latter causes 
progress in the former In contrast. 
Tiedeman and O Hara (1963) assunjp 
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that persons progress through stages 
of development m a cyclic fashion 
m which there are reciprocal, bidirec- 
tional person-environment «mterac- 
tions This approach (Peatling & 
Tiedeman. 1977) assumes that as one 
defines self through one s self-reflec- 
tive tho'ughts and feelmgs, one en- 
gages in activities which implement 
the self-concept and the conse- 
quences of these activities serves to 
further 'differentiate or redefine the 
self The direction of effects found 
in thotpresent study reflect the dif- 
ferentiation of the self following ca- 
reer implementation and are thus 
more consistent with the. model pro- 
posed by Tiedeman and his associ- 
ates than that proposed by Super and 
his associates • 

These results"* have important im- 
plications for career counseling The 
first IS that focused interventions 
aimed solely at modifying specific 
attitudes (e g , sex-role attitudes, 
self-concept clarification) in order 
to change specific behaviors (e g , 
choosing a college major) may be 
overly simplistic Such narrow goals 
for counsehrig do not take into ac- 
count the bidirectional, reciprocal 
relationships found among these var- 
iables A second implication is that 
counseling students toward satisfy- 
ing career commitments will also 
cause cognitive and attitudinal 
changes in students and that these 
changes, in turn, will affect one s 
career decision making, A third im- 
plication IS that the kinds of changes 
and their direction will vary across 
class levels, so that these factors 
need to be taken into account- in as- 
sessing individual client s needs and 
in establishing goals for counseling 
The findings related to the direc- 
tion of causality between sex-role 
attitude^ and cognitive styles were 
not consistent with the results of the 
path analysis reported previously 
{Harren et al, 1978) in which it was 
assumed that sex-role attitudes in- 
flu^ced cognitive styles Two of the 
three significant comparisons involv- 



ing sex-role and cognitive measures 
suggests a direction of causal influ- 
ence whicK is opposite to that posited 
in our earlier wort< Thus, our future 
conceptual models which attempt to 
account for the growth on s^ex-role 
Jynd cognitive measures must recog- 
nVe that these sets of constructs 
exert a complex source of influences 
on each other Our theories must 
reflect this interactional, bidirec- 
tional involvement 

The third set of findings revealed 
that self-conception of feminine qual- 
ities followed increases in liberal 
attitudes towards women's sex-role 
behaviors in general In addition, 
liberalization of attitudes towards 
male appropriate behavior followed 
liberalization of attitudes towards 
female appropriate behavior 

These findings and the previous 
two sets of findings have some direct 
implications for counseling psycholo- 
gists who have become increasingly 
involved m sex-role consciousness 
activities Most models of conscious- 
ness raising are based upon a model 
which focuses participants" attention 
on the sex-role related aspects of 
their self concept (Brodsky. 1973. 
Farrell, 1975. Pogrebin. 1973. and 
Moreland. 1976) The assumption is 
that if individuals expand their view 
of themselves to include quaht>es 
typically ascribed to the opposite sex, 
that this will be followed by changes 
in peoples' attitudes toward role 
appropriate behavior for men and 
women, and increases in peoples' 
ability^ to make, and derive satisfac-* 
tion from, decisions Data from the 
present study suggest that changes 
in the sex-role related aspects of stu- 
dents self concepts may be facilitated 
by changes in their s^x-role attTtudes 
towards others, changes in their uti- 
lization of particular decision-making 
styles, or changes in their decision- 
making abilities 

A final implication, or perhaps a 
caveat to both researchers and coun- 
selors, IS that we should hold m^pre 
tentatively our cherished theoretical 
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assumptions (e g . career commit- 
ment involved the implejnentation of 
the self-concept. ^attitudes towards 
others follow changes in the self- 
concept) . 

Rather', we should resist our ten- 
dency to simplify and our desire for 
stability and retognize the complexity 
and changing nature of th^ person- 
environment mJeraction 
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Synthesis ^ • - . , 

RIPPLES: 1975- 
Deep Structure 

We approached this review. by first outlining the deep structure withm 
which the theory of career development for white males is currently 
embedded In this deep structure, the choice of an occupation is con- 
ceived to occur within the interaction of the self concept and action 
predicated upon that self conc^t. The processes of this^ interaction 
are outlined fairly clearly for the childhood, adolescent, and young 
, adult phases of the occupational choice. Furthermore, the Holland 
and the Roe theories of occupational classification do a fairly good 
job of conveying the predictable variance from the ways in which 
persons presently satisfy themselves with the occupancy of their time 
to the ways in which they continue to occupy their time at needs 
satisfying, work in a somewhat later time jn their lives. However, the 
development of the career is less well marked for tl^ middle and late 
adult stages of life. Furthermore, the theory has\not been generalized 
so that it remains robustly inclusive of the caSpeer development of 
females and the poor as well as the white malesS Finally, the theory is 
primarily based in the concept of choice, not in th^ concept of decision 
^as wfe believe it*«should be. 

Emarging Themes 

Our review of the research in career developrr^ent published during the 
past five years indicated that the deep structure of theory in career 
development persists but that there are some newly emerging themes 
offenng promise. Among the thennes under investigation is the funda- 
mental one. does career develop or nof? It appears that there is less 
question of whether the career develops or not than there is of the 
question of how. Most people seem to take career development for 
granted After all, most people experience that development in their 
own lives and more or less take it for granted. But few trouble to con- 
sider career to be*constructible as we argue in this section. 

Besides needing a change from the choice to the decision paradigm, 
c.areer development theory needs additional explicitness This latter 
need manifests itself through the publication, since 19/^1, of several 
theories written with behavior as the organizing theme. However, deci- 
sion is a^so being advanced as the locus of the self constructed career 
and this line of thinking is broadening focus on the driving mechanism 
Qf career development from the interaction of self concept,and action 
to thought and action. In this process, the principal paradigm for the 
driving forceiricareer must shift from choice, where it has been stalled 
since about 1^0, to decision. We consider this point in more detail later 

Age stage limite^t theories of career development are also coming 
into being at this time. Care'er development during college instruction 
IS Particularly singled out for development of this kind. However, efforts 
^re now being^ directed towards derivation of special theories for 
fepiafes, older adults, and groups with special needs. These efforts are 
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* necessary in order to make more explicit what we want to include in 
the more comprehensive and^gen^ral theory which would be the more 

> advantageous career development theory io have. Sut.wje' rjnust after 
ali creep before we can walk. However, we must not forget.that we want 
to walk and pemaps even eventually to run so that we should keep our 
minds on t^e pr.ovision ofa more comprehensive and more general 
theorv'as well as work in the special regions of particular cpnditioas 
^ Another theme comm^ into career (development is that associated 

* with jhe provision ol ah education which enhances career develop- 
meqT These efforts are clanfying^ our assumptions that career does 
devilo^) and that we can facilitate that development rather than just 
waiting for nature to take its course. This is the force which makes the 
change from a choice to a decision paradigm as driving mechanism*ln 
c^eer so important to the practice of career education, in which voca- 
tional education has played such an active part. When we can empower 

^ individuals to take responsibility fox their decisions and lives, we will 
\^>je provided a career ed'ucation in which career development can be 
'l^'3,elf sustained and constructed. 

. Our constitutional guarantee? of equality are being honored actively 
^\ this juncture of our country's development. The rights of minorities 
band women to conditions of equity in life's chances are therefore being 
highly stressed as the federal government strives to make its consti- 
\ tutional principles uniformly applied throughout the states of our 
'} federation. )ln this press, investigation of sej^ roles, stereotyping, and 
- k bias has a/celferated. These investigations have generally found that 
• / the habits which have arisen when persons were not as conscious of 
^' the lack of^equity in iheir Ufe chances are hard to change These habits 
% do require us to change so that the pursuit of. ind'ividuarpurpose and 
f\ joyfulness can be possible for all. However, those who would change 
^ the individual by merely changing the environment are doomec^ to 
' anger as they review the research on the imprint of sex rolp, stereo- 
typing and bias on occupational behavior. Individuals must^also wake 
I up as their environments change if they are to cooperate with the evolu- 
'"i tion of personkind during their lives by taking control of their develop- 
'•^ , ment This need emphasizes the impor^nce of the swing from a Choice 
to a decision paradigm in career development, a need which we pursue 
as our integrating theme in this section. 
^ The marked changes taking place in our society and its technology 
at this stage in our country's development have also brought the lat^ 
'^^ adult years into the limelight of investigation in career We are finding 
V that adults must continue to learn and grow if they are to remain current 
\r with the increased rapidity in social change. Unless self constructing 
t "^ activity caa quickly become a part of the adult years, an increasing 
number of adults will be wondering where the game of life went They 
will no longer consider themselves playing in itXAnd we rob individuals 
of confidence in their control of themselves ^d their so4i^ty at dire 
. social risk. The emerging literature on the development of) the career 
. " in adult life offers promise of helping in these n^ded pe/sonal develop- 
.ments. Perhaps America needs some new shibboleths such as There's 
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, nothing wrong with America which we grey-headed Americans coul8n't 
cure. " Or, Wake up^rey-Tieaded America! L'en^J your experience to 
devising the ope/ating manual tor Spaceship Earth." ^ 

Finally, the measurertien} and evaluation of parts of career develop- 
ment continues as a strong theme in its research literature. A great 
deal of attention was gjven to making interests less dominated by sex 
stereotyping. Several new instruments came into be^ng in the past five 
years. These instruments have fortunately higlilighted processes in 
career development, an area in which our instrumentation has 
weakness. ^ 

Pebbles with Ripples '\ 

Jn the prior section, we cast four pebbles intd the currently cafl^ pond 
of the deep structure of career development theory which is presently 
characterized by the research themes we ju^t summarized. Those 
pebbles were (1) an overview of the cross sectional story of early career 
devel^opment, (2) a comparison of the predictive power;5^of three oc- 
cupational classification systems, (3) a sociaflearning theoi^ gf career 
selection, and '(4) a chicken and 6gg study. Wheniwe introduced those 
studies, we suggested you considerjl) the topic or focus, (2) the pur- 
pose, (3) the method, (4) th^ findings, and (5) the implications of each 
as you reafd it We felt that doing so woura direcft your learning so that 
you could hierarchically restructure ^'our understanding of career 
development theory as you' read the studies. We therefore first lead you 
through some of the hierarchical restructuring of our own thinking, 
which was occasioned by each of those articles. In doing so we will 
■ also makd^se of the five areas that we suggested you use 

We offered the overview of the cross-sectional story of early career 
development because it is one of the more exact indications of what 
we can expect iri the way of career and occupational development at 
the present time. As indicated, the National Assessment of Educational 
Progress (NAEP) define^ the national population it samples and then 
constructs a scientific sample of that population. The sar^ple is tested' 
so that e^ry person tested does not tomplete all of t^e exercises 
whiQh in wTeir totality fJetine'the universe of tested behavior The result 
IS that we^ecure a very clear idea of which behaviors exist in what pro- 
portion at four ages in our population. But we cannot reason with these 
data as we are accustomed to do in psychology, namely as the scores 
of individuals on various scales of individual differences. The NAEP 
data doTiot indicate'how much career behavior any person has in the 
United States although they do make it possible to estimate what pro- 
portion of people in^the United States will exhibit each piece of career 
beha.vior. 

The NAEP study in addition to being of interest because of its national 
scope and different methodolog|/ also provides an extremelyidioterest' 
rng guide to the possible development of occupational behavior in a 
few^of those capacities which are transferred to career development. 
The rudimentary look at early career development which the NAEP. 
exercises afford suggest that considerable wbrk exists for vocational 
educators and counselors in facilitating the evolution of career thinking 
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and makmg during human development. Counselors are not attributed 
much presence-ih the development of career behavior by those tested 
in 1973-74 b</ the NAEP. As a result, little personal respohsibi|fty and 
capacity for career has developed by seventeen to say nothing of the 
adult years from 26-35 as well. In general, it appears thaUhe American 
people may well have basic existential career literacy but that they 
• remain essentially seedlings in the groves of career development. 

Project TALENT offers another scientifically constructed sample of 
the adolescent population in the United States m 1960 Thesub^quent 
follow-up of subjects tested in 1960 provides unusual opportunity to 
secure predictive information on the instruments used in the Project 
TALENT testing phase. In addition, the later initiation of the National 
Longitudinal Study of the High School Class (NLSHSC) of 1972 pro- 
vides another national sample which Is also being followed up in 
reasonable similarity to Project TALENT's design. The dual use of these 
two studies as m the design of the Transition to Work Simulator (Con- 
roy, 1977), alleviates a major problem of Project TALENT despite its size 
and representatives. In Project TALENT alone its subjects mature but 
Its predictive data remain of their era, not of today's era When the data 
of Project TALENT and of the NLSHSC of 1972 are used harmoniously, 
we can isolate some of the era differences which-exist in career be- 
havior as well as gam more stable estimates of the career consequences 
of various kinds of adolescent interests and achievements 

Within the Project TALENT design it proved possible to compare 
the career stabilities evident mjhe Flanagan. Holland and Roe systems 
of occupational classification.' Since those systems have 12, six and 
eight occupa^onal categories respectively, a method had to be derived 
which discounted vanability due to different chances for it to happen 
as the p/oportions of persons whovemained in the same occupational 
category from the beginning to the ending period were determined and 
compared Interestingly.' category-equalized career stability proved to 
be about the same in all three classification systems but. not surpris- 
ingly, decreased i*n all three systems as the interval over which the 
stability was measured increased Also, not surprisingly, career stability 
increased as the base for its measurenrjent was taken at the young adult 
age rather than the adolescent age Patterns of change mildly con- 
formed to the circular a^tterns claimed by Holland and floe and the 
linear pattern which the authors hypothesized for the Flanagan system 
Interestingly, career flow was generally away from intellectual careers 
to careers m business an^sales but each system had unique results as 
well ^ 

During 1973-74. the National Institute of Education let a contract to 
the American Institutes for Research to review the literature on career 
decision making and to propose researc h that needed doing on the topic 
(for report see Mitchell. Jones. & Krumboltz. 1979). The paper on social 
learning theory in career selection by Krumboltz, Mitchell, and Jones 
(1976) was a m^jor outcome of that work 

The paper is included among our pebbles because it marks a part 
of the change from the domination of career development theory by the 
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paradigm of "choice and the introduction into career development 
theory of a paradigm of decisions. Furthermore, the paper also illus- 
trates the care'with which one proceeds in the evolution of a theor^^. In 
theorizing, terms and relationships must be given an explicitness and 
cnspness which make them readily communicable aj)6 usable but the 
care given to these conditions by Krumboltz, vJones and Mitchell is 
unusual m the construction of career development theory to date 

Notice once again the structure of this paper. A statement of the 
problem is followed by specification of factors that influence the nature 
of career decision making. Included are.genetic endowment and special 
abilities, environmental conditions and events, learning experiences 
including instrumental and associative and task approach skills The 
next section postulates explicit interactions among the previously spe- 
cified influencers of career selections. Specified among the interactive 
effects are self:Observdtion generalizations, task approach skills, and 
actions. These specified interactions are then followed by descriptions 
of the process of career planning and development The process is 
specified in general and illustrated in several cases. Theoretical prop- 
ositions and illustrative hypotheses then follow. Proposittons and 
hypotheses are formulated in terms of influences upon preferences, 
career decision making skills, and entry behavfors. In each case prop- 
ositions are offered about both positive and negative influences The 
paper concludes with statements of several implications for coun- 
selors and clier^ts. 

This paper, illustrates the value which keeping a fairly strict learning 
orientation offers to the formulation of testable hypotheses about 
aspects of career decision making. The paper also holds promise for 
articulation with an expanding theory of personal implication in career 
decision making because it holds open the possibility both for instru- 
mental learning and self-observation generalizations. However, in 
these regards the theory does not go far beyond the postulated de- 
pendence of occupational behavior in the interaction of self concept 
and action which Super introduced into the field in 1953. The present 
theory does indicate how these influences figure in career choice more 
explicitly than earlier but the theory is still primarily a career choice 
theory, not a career decision makmg theory despite its use of career 
decision making as one of its primary terms You need only compare 
the definition of "decision" proferred in the article, " . thf selection 
of an option from among two or more alternatives . . " (p 71) with that 
offered for choice" in Webster's Third New International Dictionary 
to seelhis fact. Should you care to contrast ther^aper's definition with 
that of -decision" offered in that same dictionary, we feel you would 
concede ourpoint. \ 

Our point brings us to the fourth and final pA^bble we have cast iato 
the calm pool of career development theory in order to examine their 
ripples. Kass, Moreland. Harren and Tinsley (1979) pioneer use of cross- 
lagged panel comparisons in their included study of career develop- 
ment. Causal inference Is slowly creeping into psychology but it hasn't 
been us^d too frequently in career psychology. Causal inference is 
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riskier than non*causal inference. You can set yourself up for great falls 
by use of faulty inTer^ce which can easily result from the false positives 
yvhiqh slip through causal inference just as they do through non-causal 
inference, only more so because of the burden of extended jnodeling 
assumed in causal inferences. However, the gam you achieve in having 
causes under, control rather than just correlates is well worth the risk 
and we should urKlertake that risk more often Perhaps if we did so we 
could hasten the emergence of career psychology into greater benefit 
in the construction of career development interventions We must 
know why and how things work, not just that they work. As we know 
why and how things work, we are able to put them to our use. not just 
to be creatures of vanous effects and "learnings." 

HSrren and his associates have given Tiedeman several surprises 
relative to Tiedeman s thought since Harren's initial work on it in 1966. 
In 1963. Tiedeman and O Hara published Career Development Choice 
and Adjustment. This monograph was written conjointly with the 
writing of Career Development, Self Concept Theory by Super, Stari- 
shevsky, Majtlm. and Jordaan (1963). ^Professors Bofow, Jordaan, 
O Hara. Super. Tiedeman and Volsky had^the opportunity to join in 
seminar during 1962-63 to outline the state of career development 
theory for each other and to prepare monographs which summarized 
their work and pointed to directions each considered important Tiede- 
man and O Hara elected to write within Super's assumptjons about the 
development of the vocation within the career but to highlight that 
development ^s identity development of relevance to career and to 
emphasize the cychc nature of decision making which takes place in 
the life in the personal unfoldrtient of the career. Tiedeman and O'Hara 
were aware that tbfey determined a structure in how they wrote but 
they elected to calll their general conception a language rather than a 
theory They-did so to stress their feeling that they had defined neces- 
sary elements and interrelationships but'had done nothing to define 
what the behavioral outcomes might be. 

Because Tiedeman and O'H^ra specified only a language and not a 
behavioral theory, they were surprised in 1966 when Harren published 
a paper in which he had denveda behavioral measure for development 
of two of the career decisions which were predic'ated by Tiedeman 
and 9 Hara and demonstrated developmental differences 'in these 
decisions among the college stCTdents vyhom he studied The fourth 
pebble we have cast into the calm pond of todayis career development 
theory similarly surprises Tiedeman. Notice that Harren and his col- 
leagues bring the results of this present investigation to bear on the 
difference in paradigms adopted by Super. Starishevsky. Matlin. and 
Jordaan in their 1963 Phonograph and that adopted by^Tiedeman and 
O Hara in theirs. Harren and his colleagues find support for the recip- 
rocal, bidirectional, person-environment interactions which Tiedeman 
and O Hara were trying to introduce into the theory of career develop- 
ment in 1963 rather than for the crystallization of the self concept as 
prime cause in career development as Super and colleagues assumed 
This IS the first evidence for some of the cyclic as^unnptions of the 



2[)o 300 



Tiedeman and OHara monograph which have come to Tiedeman's 
attention. Although the results are those of a single instance, they 
nevertheless suggest that the more open system considerations of 
cyclic decisional processes are more essential in career development 
theory, than the deep structure of career development theory sg far in- 
corporates. That IS the integrating theme of th^s review, one which will 
be pursued more fully followmjj upon a few more conrfmerfts on the 
included work of Harren and his colleagues. 

As you read the paper of Harren and his coHeagues imagine some of 
the jOys and agonies of research investigators. The paper references 
Harren's Assessment of Career Decision Makmg (1976) instrument 
That instrument is a refined version of an instrument with which Harren 
began to experiment m 1966 when he first tested the Tiedeman and 
O Hara proposition about the development of career decision making 
in cycles. At the present time Harren has both broadened this Instru- 
nlent to include information on decision making style as well, as infor- 
mation on the accommodation of the college choice which is one of 
the three structurally defined career decisions in action during college 
attendance. The other two are selection jof a major and selection of 
an occupation, the first of which presumably goes through the several 
stages of. career decision making associated with both anticipation 
and accommodation and the second of which continues in the stages 
of anticipation while in college. Harren and associates have dona a 
great deal of work with this instrument and have presently devised a 
theory of career decision making during the college years (Harren. 1978) 
which has gone far beyond its origins in the work of Tiedeman and 
O Hara. At the present-time, Harren has pretty well carved out his own 
theory of the specific processes of career development which are likely 
to transpire during college attendance. 

But all is not joy in research. Note in the paper by Harren and col- 
leagues that they refer to prior publication of a paper by Harren, Kass, 
Tinsley, and Morelaad (1978). In that paper, the authors used path- 
analysis presuming a model of causality in which it was assumed that 
sex-role attitudes influenced cognitive styles. Notice that they wnte on 
page 15 of the included study that two of the three significant com- 
pansons involving sex-role and cogni^ve measures suggest a direction 
of causal influence which is opposite to that posited ip our earlier 
work." This finding is not unusual in the scientific pursuit of generalities 
free of contradictions. They seem to crop up more frequently in the 
hazardous ground of causal analysis in which Harren and his col- 
leagues presently work than they do in the "ground of correlation in 
which earHer career theorists worked. But we should not let that fact 
deter us from efforts to understand at more fundamental levels. Instead 
we should remember that the results of the included study are based 
on a broader model and mora inductive study than was the former one 
We should also remember that the results which Harren and his col- 
leagues (^port in the present study are not nrvuch more numerous than 
those that can be anticipated by chance in the overall Neither are they 
too consistent from college year to a next college year. But uncertainty 



IS what makes^ science so interestipg, uncertainty challenges explora- 
tion and resolution. It takes only one significant thing to'set off a poten- 
tially long list of discoveries and you can never be certain whether that 
which proves significant in one case is a false positive or$omething of 
real worth You ve just got to keep inquiring of the envfronment and 
doing your best to make sense of what it tell^ you from your inquiries 

Rocked in, or Rocking, the Cradle of the Deep? 

We argue -that career research is presently rocked in the cradle of the 
deep structure of career development theory. That deep structure 
hasnt changed much rn two decades. In this review we cast a few 
pebbles into the pond of that deep structure of career development 
theory in order to ^ee if we can rock th6 present structure of career 
de\/elopment theory m your mind or not/We do so in thislconcluding 
sub-section of trying to coordinate the npples of the four^ebbles we 
have cast into the pond of the present deep structure of theory in career 
development into a harmonic wave which Vvill help you realize the value 
of basing our career development theory in a decision, rather than a 
choice paradigm as it is at present. 

A simple choice*^ Not unless you chbose rather than decide To decide 
you must choose to do so and then you must reciprocally choose within 
that choice in order to decide the matter you have chosen to consider 
That step will advance your participation in what you believe andVo 
based on a stage which Tiedeman and Miller Tiedeman (1975) call that 
of choosing m order to decide. To complete the pr9cess of deciding 
by becoming fully involved in tfne decision, you must finally complete 
the cycle by engaging in the mirror image of the stage of choosing in 
order to decide, namely the stage of deciding in order to choose When 
you master in this six-stage process in relation to your career — the* 
series of choices our society and you subsume in your life — it seems 
reasonable to us that you have gamed 1" power, or career maturity if 
you feel safer rocked in career theory's current cradle, not to rock that 
cradle as we attempt to do in this sub-section Our purpose in this re- 
view, particularly in this sub-section of it, is to argue that this principal 
driving mechanism ofpersonal integrity in career, 'I" power, must be 
rocked into the curreht deep cradle structure of career 

We have first been inclusive'in this review so that you can see both 
the stabilization of the de^P structure of career development theory 
and some of the current themes which cry for reorganization of the 
paradigm upon which the deep structure of our current beliefs about 
career develppment rest. We have sought to be as explicit as we can be 
m the restricted space at our disposal so that the reader can judge the 
bases of our conclusions. However, in this regard, space allocation 
forced a briefness which required presumption of prior knowledge of 
the deep structure of theory in career development In such instances 
we have provided references which interested readers can pursue in 
checking ou.t our statements and conclusions But for all that.^we 
deliberately cast illustrative pebbles into the calm pond of the deep 
structure of career development theory picked both to illustrate some 
well done and interesting research and to make a point for the present 
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need to switch the paradigm underlyjng study of career development 
from that of choice to that of decision. And this is where w^^now take 
up consideration of those studies both to establish that there is a dis- 
tinction in the two paradigms to which we, point and that that distinc- 
tion makes a difference in what we are IJkely to discover about career de- 
velopment were we to use decision Vather than choice as basis for 
thinking in formulation o.f career development theory. 

What is this distinction between choice and decision processes 
which we consider central to the reformulation of career development . 
theory on terms of decision making rather than of occupational choices? 

In discussing the included paper by Krumboltz,- Mitchell, and Jones 
we indicated that the paper was initially prepared as the discussion 
document for an advisory panel, the members of which were asked to 
comment upon the social learning theory o'f career decision making 
and to suggest research in career decision making which ought to 
be undertaken on its terms. Tiedeman and Miller-Tiedeman were a part 
of the advisory panel and submitted a position paper which they en- 
* titled "Choice and Decision Processes and Careers" (1975). In this 
paper, Tiedeman and Miller-Tiedeman use common definitions to the 
effec.t that a choice is a preference among alternatives and that a deci- 
sion IS a set adopted in action dictated by cFjoice. In that lexicon, there 
are processes related to (1) choosing, (2) deciding, {3) choosing to 
decide, (4) deciding to choose, (5) choosing in order to decide, and (6) 
deciding-in order to choose, all of which have specific meaning in the 
subject of decisions which lack meaning in the subject of choice. We 
illustrated those differences in introducing you in this sub-section to 
your choice of paradigms for future work in career development 
theory These are the grounds which^have led us to argue that the 
paradigm of decision is the more fundamental paradigm on which we 
should base the study of<:aree'r development in preference to the para- 
digm of choice on which the present deep structure of the theory is 
basedt * ^ 

Tiedeman and numerous colleagues reached»this conclusion in a 
long series of work which pravides a number of explicit bases on which 
we can rapidly ground career development theory in decision making 
rather than fn choice if inclined to do so. We summarrze that work here 
jn order to make a work basis available to readers inclined towards con- 
certed attack on decision making as driving force in career development. 

Tiedeman hiarks his initial insight into the distinction between choice 
and decision with development of the book,' Multivariate Statistics 
for Personnel Classification which Rulon. Tiedeman, Tatsuokfi and 
Langmuir (1976) wrote. That book presents the explicit context within 
which we designate decision rules for predicting group membership 
from test data on persons whose later group membership is not known . 
when predicting. The rules are derived ip a Cartesian space supposedly 
spanning the (est scores of similar individuals whose later group 
memberships are known when dejihing the rjjies. Although Holland 
and Ro^ arrived at their occupation^ classification systerps by em- 
ploying different logic, since both claim that their systems are essentially 
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circular in nature, both really 0Fy§rate in terms of circular segmentation 
of the two discriminant functions offered by the observations leading to 
the occupational classification of each subject. However. Holland and 
Roe — and Tiedeman in his beginnings — were particularly fascinated 
by the prediction of the occupational choice which. a person would 
make, this is an initial aspect of career development but not the whole 
aspect. This initial aspect establishes a structure of roles and potential 
need satisfaction butjt does not get into personal decision making 

processes. u • < 

Tiedeman began moving to choo^ng, rafher than choice, as basis for 
career development as he came into association .with Donald Super. \ 
Robert 0 Hara and others who made him aware of self conceptions 
as grounds for the time occupations of persons. In a self concept origin ' 
of occupational choice, it is as if self conception^seize one and force 
occupancy of one s time for their satisfaction. Tiedeman and O'Hara 
essentially accepted Donald Super's view in this matter durirfg 1962-63 
while Super and Jean Jordaan wereat work with Starishevsky and Matlin 
in the elaboration of- their self conceptjDased conceptions of career 
development. However, Tiedeman and O'Hara elected to conceive 
career development within the theory of identity development and 
realized that they had to provide for the process of choos/ng in doing 
so by placing the chosen area for time occupancy within the presumed 
deveiTspment of a decision, choice, forged in the potential steps of 
exploration, crystallization, choice, and clarification during its antich 
' • pation and m the potential steps of induction, reformation, and integra- 
tion m Its accommodation during implementation Choosing and 
. , decid/ng were therefore both included in this conception of cyclic 
differentiation and integration which Tiedeman and O'Hara introduced 
as mechanisms in career development. 
Two career development issues converged in Tiedeman s thinking 
V during the decade following publican iif Career Development' Choice 
^^and Adjustment (1963) with O^Hara. On the one hand, Tiedeman and a 
large group of colleagues were given a three-year opportunity to design 
an interreactive computer environment in which the curious could 
repeatedly inquire in relation to matters of schooling, occupation.^ 

militafy-sepviGer -and- personal and family living Tiedeman and his col-* 

leagues worked out a design in which the data files containing the tacts 
relevant to a wide variety of questions in one or more of the four areas 
of basic life decision could be queried in ways intended to arouse and 
to perfect the inquirer s understanding of comprehension, the dividing 
in order to combine and combining in order to divide^ and simul- 
taneously — which IS characteristic of getting to know wheh you assume 
responsibility for what you presumably then know. Tiedeman has a book 
on this design in press. . It will be published as Career Development- 
Designing Our Career Machines in the near future This work essentially 
continued the work on developing the sen$e of personal presence in 
one s career which Kehas (1977) and Field (1977) had initiated in'Tiede- 
man s thought. In the meantime, Katz (1974) with his SIGI (System for 
Interactive Guidance and Instruction) and Harris-Bowlsbey (1976) with 
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her Discovejr system have both. put aspects of this basic design into 
current operation. Katz emphasizes valuing as a point of entry to career 
development consciousness, Harris-Bowlsbey emphasizes decision 
making. Katz has made excellent use of the fSrostttesis to the mind 
which an interactive computer system can be.yvhen apprpriately pro- 
grammed both to derive a decision makmg simulation which can be 
used as a test of progress in decision making development (Katz, 1975), 
arid to study sex differences in the actual processes of decision making 
encoded in SISI as inquirers specified their values and made their 
occupational choices under system guidance to be consistent in the 
occupational expression of elected values or to change the values 
(Norris. Katz & Chapman, 1978). 

At the same time/as Tiedeman was at work on the relationship which 
he considered neciessary to develop in order to make a computer system 
interactively prosthetic to the mind during times of choice as one worked 
to perfect personal command of one's decision making developments, 
Gordonf Dudley worked with him to make him conscious of the mind 
processes involved in mastery of >he relationship of structure and 
function in the construction of the self as career. Dudley and Tiedeman 
published their work and that of several colleagues on this issue in 
Career Development, Exploration and Commitment (1977). Within the 
duality of structure and function it becomes possible t^o grasp the con- 
cept of hierarchization which be^bmes possible during differentiation 
and integration of one's conceptual system. For instance, you will 
have to differentiate your understanding of the present deep structure 
of career development theory if you are to reintegrate it into the con- 
cept of decision rather than of choice as we contend it presently is. 

While Tiedeman was reintegrating into his conceptualization of 
career development the described mind prothesis relation of ISVD 
and the concept hierarchization in structure-function development 
during creativity, John Peatling advanced a group theory of personality 
reconstructionism to him. Together Peatling and Tiedeman then trans- 
formed Ligon's (1970) original group model of piersonaiity reconstruc- 
tionism into an Abelian group which at its fifth level of differentiation 
contained sixteen elements They also fashioned these elements into 
a hierarchy within which it became possible to hypothesize develop- 
ment through four differentiations from the unitary state of personality 
to the sixteen element state of self constructionism. The model for 
the Abelian group of 16 elements unfolds from multiplication of the 
polynomial (I + a) (I + b) (I + c) (I + d) where I is the identity element, 
u niqueness, a is the first generator element, endowments, b the second, 
self-image, c the third, action, and d the fourth, decision making. It is 
interesting to array the levels of the Peatling and Tiedeman model 
against the first five levels of Erikson's (1959) model of psycho-social 
identity development. Tiedeman feels that the Peatling and Tiedeman 
model corresponds at these levels and awaits additional research which 
wilJ differentiate the missing three levels during the adult years but 
Peatling is of persuasion that the fifth level of the model corresponds 
with Erikson's eighth level, integritY;^nd that several of Erikson's 
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stages are subsbmed tn one or more of the intermediate levels of the 
Peathng and Tietieman model. As Tiedeman became more tutored in 
Peatling s original group model of personality constructionism, he 
succeeded in drawmg^l^eatling's attention to the heuristics available 
m the exercise of designing a machine which will let you, relate to the 
known so that you can experience the process of getting 'to know while 
leaving a record for yourself of how you did so. The two therefore 
wrote Career (development, Desigfiing Self (1977) which turned the 
group model of personality reconstructionism \n\o an ISVD-like re- 
lationship for liie, nbtjust occupational, decisions which became their 
self constructionist grotip model of personality reconstructionism 
This IS just a more exact way to refer to those processes which are in- 
volved in your getting to comprehend what was known by another so 
that you understand and use it and eventually comprehend both the 
object of the understanding ap6 the process of comprehending itself 
During tpe past eight years, Anna Miller-Tiedeman has profoundly 
influenced Tiedepnan's thought on the mastery of career decision 
making as the object of career develojDment. The two met because both 
were interested ifi career decision making, Miller-Tiedeman in teaching 
It in secondary.school and Tiedeman in understanding it in career de- 
velopment. Miller-Tiedeman has had initiative in further differentiating 
Tiedeman s thought with regard to the c^entering of the self in one's 
decision making development. She started statement of that process 
m a 1972 paper (Miller & Tiedeman. 1972) in which both of them derived 
a model of decision making development which had to be mastered 
m moving to comprehension of thought development Miller-Tiedeman 
later constructed a simplified pyramidal model cut along the principal 
diagonal of their original cubistic model and made this the basis of 
efforts to bring its structure Jnto the comprehension of secondary 
school students. She reports her work on this problem in a forthcoming 
book with'Tiedemah which they entitle Career development Journey 
mto "I" Power (Miller-Tiedeman and Tiedeman. in press) This book 
deals with the cooperation with the evolution of humanity it is possible 
to empower personally by taking responsibility for one's life during 
ones development as a bemg, Miller-Tiedeman and Tiedeman dub 
this empowerment, 1" power. Comprehension of decision making 
development is the pnme mechanism of "I" power. 

In her work with middle and secondary school systems. Miller- 
Tiedeman has discovered that frequently learners have to grow into 
full use of the seven stage Tiedeman and O'Hara paradigm of decision 
making outlined above. Learners don't^naturally use it although every- 
one IS theoretically capable of it. In her experience. Miller-Tifedeman 
has found that learners' comprehension of the Tiedeman apd O'Hara 
paradigm of decision making ordinarily expands in the following way 
Level • Arlticipation t Accomnriqdation . ^ 

1 Choice ' Reformation ^ 

2 Choice/Clarification Reformation 



3 



Crystallization/Choice/ 

Clarification 
Exploration/Crystallization/ 

Choice/Clarification 



Induction/Reformation 



4 



I nd uct i 0 rV Re f 0 rm aTiCi n/ 
Integration 



As Miiler-Tiedeman wrestled with the problem of how to help ado- 
lescents empower thought m their daily actions, particularly their daily 
actions relevant to progre5smg toward^ a tentative occupational choice, 
she started to teach her pyramidal model as necessary to mastery of 
career constructionism in expectation that learners would generalize 
that which they. then know to that which they are then doing, that is to 
act as if the necessary is sufficient. Although Miller-Tiedeman (with 
Tiedeman, in press) achieved some acquisition by learners of that 
which IS known to he_r. she began to discern that generalization of the 
necessary into belief of its sufficiency required a strategy in which the 
necessary in deciding is taught during times when the sufficiency of 
decision in life is imminent, not otherwise as she had been doing. When 
learners are suffering crises in existential choice they are much more 
amenable to comprehend the value which mastery of the decision 
process offers them than at other times. At other times, decision making 
IS tiresome, not powerful, at least for adolescents. In her revised strategy 
for moving students from the necessary level of dealing with choosing 
and deciding to a level whore they are personally putting that necessary 
and other-specified framework into the sufficient one of choosing to 
decide and deciding to choose, Miller-Tiedeman has found that ado- 
lescents in, secondary school only infrequently move very far in their 
comprehension 'of comprehending, that is in their comprehension of 
the logical problem of choosing in order to decide and deciding in order 
to choose. It appears that the cognitive structure — of. doing correctly, 
understanding, and comprehending creatively in acting as if one knows 
— has a time-extended life of considerable duration, a duration which 
IS only sHghtly co-extensive with the cognitive development ordinarily 
transpiring in the adolescent years coinciding with secondary school 
attendance. Miller-Tiedeman (with Tiedeman, in press) has achieved 
statistically significant gams in ego development in her direct-instruc- 
tion strategy but she has found those gains at a relatively low level on 
the Loevmger (1 976) ego development scale. In addition. tTiaTsnian gain 
IS achieved at sufficiently high psychological cost to the instructor to 
have caused her to modify her strategy as reported above 

So much then for available resources on career decision making 
development. Now back to the major question of this sub-section, 
namely, will you in the future ground research in career development 
theory m a decision making paradigm or continue to pursue the topic 
only in terms of an occupational choice paradigm? 

Our discussion has so far made the points that the contract which the 
National Institute of Education initiated with the American Institutes of 
Research in 1974-75 Started in process of introducing social learning 
theory into career decision making by Krumboltz, Mitchell and Jones 
and that the concepts of career decision making had been under de- 
velopment by at least one investigator and his colleagues for about the 
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previous two decades. We have also noted that the Krumboltz. Mitchell 
and iones model offers both instrumental learning and self-observation 
generalizations as places within which the theory of self-constructed 
career development berng built by Tiedeman and his colleagues can 
find union. If you attempt to create a union of the social learning theory 
of-career selection with the paradigms of career decision making under 
development by Tiedeman and his colleagues, you will have to decide 
two things. First, will you admit completely individually generated 
knowledge as learned material? The models with which Tiedeman and 
his colleagues work not alone inglude this form of knowledge, they give 
major emphasis to it as the expansion of personal perception in a reality 
in which the learner does not detect or project deceit. Second, to what 
bottom line dimension would y6u have personal and communal knowl- 
edge sum in your modeP In the models with which Tiedeman and 
Miller-Tiedeman work in the personal revelation of T' power to in- 
dividuals with whom they work or whom they study, they sum to the 
bottom line dimension of personal comprehension of existential move- 
ment towards aloneness with personal control of bearable levels of 
ensuing .loneliness (Tiedeman. 1979). It is not clear to the authors to 
what bottom line Krumboltz. Mitchell, and Jones suggest that their 
social learning theory may be used It.appears that the model is intemded 
to be largely heuristic although it^jAn be used as suggested in its Section 
E to influence behavior in certain<Srf its fields. 

It may appear that the distinction we just made is one without a 
difference. However, it is failure to make a similar distinction in the 
grounding of career development theo/y iri the paradigm of choice or 
decision which makes a great difference in what we discuss in corP 
vention and in whether we try to change the deep structure 6f career 
development theory or not For'mstance. consider two' symposiums on 
career decision making which were offered at the convention of the 
American Personnel and Guidance Association meeting in Las Vegas. 
Nevada, from 31 March to 5 April 1979. Symposium A was constituted 
as follows: 

Is Career Decision-Making Career Maturity'? The Models, the Mea- 
sures, and the Data . \ ^ 
^A Career^Decisioa-Makmg_Modell' By^ViDJci^^ 
Is Career Decision Making Career Maturity'? A Developmental 
Perspective" by Donald E. Super 

Career Decision Making Measures in the Context of Harren's 
Model" by Dale J. Prediger 

Career Decision Making and Career Maturity. How Much Over- 
tep'?" by Gamuel H. Osipow 

The Validity of the Crites Model of Career Maturity with Ninth- 
Grade Students" by Bert W. Westbrook 

Symposium B was constituted as follows: 

Toward Assessing Developmental Change in Educational Settings 
Assessing Career Decision Processes as Developmental Change" 
by David A Jepsen f 
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Measuring Career Maturity In High School Females" by Joan 
Daniels Pedro 

i. 'Quantitative 'Indices of Qualitative Change. Assessing Moral 
Development in Medical Education" by H. Harry Daniels 
An Application of Formative Research in Psychological Educa* 
tion" by Herbert A. Exum < 

Synnposiums A and B were as different as night from day. Symposium 
A was primarily offered to address the question, Is Career Decision 
Making Career Maturity'? Vincent Harren first spoke of career.decision 
nnakmg. However, because it dealt with measures and data more than 
with models, the symposium emerged so that Its concept of career 
decision nrjaking was mostly limited to investigation of its behavioral 
nnanifestation, not to consideration of its logical structure. As a result, 
instead of straightforwardly answering, "No." to the symposium's 
structuring question and getting on with Identification of the dis- 
tinctions between career decision making and career maturity, as de* 
fined from an occupational choice paradigm, Donald Super struggled 
m the Symposium to map both concepts into a single space primarily 
defined by his conceptions of behaviors manifestations of choice* 
derived career maturity as in the foNowing table: 

Current Models of Career Maturity and Decision-Making 



5 Career Maturity 



Career Decision Making 



Super-NICEC ^ 
I Autonomy ^ 
Indepehdient 
Decision 
Making 
Internal 
^ Control 
Acceptance of 
Responsi- 
" bihty 

// Planfulness 
Present 
In termei? lale 
.Distant Future 

/// Exploration 
Querying 
Resources 
Participation 

IV Information . 
World of Work 
Preferred 
Occupation 



Crites 

I Attitudes 
Independence 

Conception 



Harren 

/ Awareness 
A Dependence 



Arroba's Styles 



Compliance 



Involvement 
^OrientaWn^ 
Preference 



Thoughtlessness 

""HesltatfOTT 

Emotion 



// Competencies 
Information 
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Problem Solving 



V Decision Making 

Principles 
Practice 

VI Reality Orientation - 
Crystallization Goal Selection 



Consistency 

Work 
Experience 

Self 

Knowledge 
Self-Situation 

Realism 
Plans 



Consistency 



Self Appraisal 



Realism 



Planning 



B. 
C. 



Reason 
Intuition 



Logic 



// Planning 

III Commitment 

IV Implementation 

(outcomes) 

1 Identity 

2 Self Esteem 



Note From IsCareer Decision Making Career Maturity'? A Developmental Perspective ' by 
D E. Super ,^ 

Note In Harren s college model Roman numerals here denote Process. Capitals oenote 
Style Characteristics, arabics Self-Concept Characteristics his developmental Tasks and 
Conditions', being societal rather than personal, are omitted here 

* The table itself should have been sufficient indication that career deci- 
sion making is not occupational choice derived career maturity Had it 
been taken that way. the paper could have avoided its implicit message 
that career maturity is presently more behaviorallj^ defined (see Jordaan 
& Heyde, 1979 for example) than is career decision making and that the 
concepts of career decision making have to project into a space common 
with the spaco af career maturity. This is fine if we are to understand 
career decision making as subordinate to career-maturity, not the 
reverse. It does not entertain the possibility either ^hat the two are best 
conceived independently with neither system considered subordinate to 
Uhe other or that career maturity might best be conceived as subordinate 
™b career decision making rather than the reverse as tabled. Actually, in 
the personal understanding of career decision making with which Tiede- 
man and Miller-Tiedeman are presently concerned, career maturity is 
" more related>4o Loevinger's egcrdevelopment concept or to the compre- 
hension of 'comprehending which Miller-Tiedeman and Tiedeman 
presently ,use as bottom line for their work in "I" power. In that frame- 
work, Super's, Prediger's and Osipow's papers suggest the depth to 
which movement towards aloneness with, acceptable person^MeV^ai^^f 
lonelme'ss has progressed in its choice maturation manifestations within 
the career. 

The measures ar\d the data considered in the symposium were* 
The Assessment of Career Decision Making of Vincent A. Harren 
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The Career Maturity Inventory of Dohn 0, Crites 
The Career Development Inventory of Donald E. Super 
The Career Decision Scale of Samuel H.Osipow, Clarke G.Carney, Jane 
Winer, Barbara Yanico, and Maryanna Koschier 

The symposium papers in their entirety both second the presence and 
slow growth of vocationally related behavior in thef^rst thirty years of life 
as revealed by the National Assessment of Educational Progress data 
infeluded as the first study in the prior Section and reveal th^ small 
amount of common variance between measures of career decision 
makjng and of career maturity during those years. It appearsn-that career 
decision making ^nd career maturity are not aloTie logically different, 
career decision making drives choice-defined career maturation in only 
small measure during at least early career development. 

Symposium B is built on a possible assumption, that decisions de- 
velop, not on the impossible assumption that decision making and 
choice-derived maturation are the same. The set of papers therefore 
make more sense in their entirety than do those*of Symposium A. 

Jepsen and Dilley (1974) have a stellar review of career decision 
making which established them as scholars in the topic. Jepsen 
launched studies of decision processes in secondary school students 
from this beginning. His paper not alone sets the stage for development 
in the decision process it also sets the stage for the symposium'slnvesti- 
gation of the assumption* of prerequisite staging in career development 
which is a primary question of development. In addition, Jepsen sum- 
marizes some of tne findings he and his colleagues have unearthed as 
they have worked with a(;|olescents in making them aw^re of decision 
processes which go on within their minds. ' 

Pedro followed Jepsen's presentation. Pedro is interested in the fact 
of femaleness and of culture in career development theory. She rightly 
points out the dependence of the present deep.structure of career de- 
^velopment theory upon the events in the lives of white males in our 
.socJety and upon a kind of "white male club" mentality. She also makes 
interesting suggestions about events in the lives of^females and minority 
group members and in tiTeir thinking "Vvhich cry for incorporation into 
a more comprehensive and general career development theory which 
we hope begins to emerge. She describes two scales she has defined 
to begin such incorporation. We believe that the empowerment' of sell 
constructionism through developed comprehension of career decision 
making development can serve as grounds for such a more compre- 
hensive and general theory. 

Daniels' paper discusses the major question about development, 
whether it is staged or not. He does so in terms of Kohlberg's4Jieory of 
moral development which is a staged theory of development and of 
Rest's, which is not. Within the limited range of mofal development 
which he investigated during the short period of only three seniesters 
of a medical education, it appears that Rest's quantitative format was 
more sensitive to short-term longitudinal changes than was Kohlberg's 
staged theory of development. 



Exum s contribution to the symposium on the assessment of develop- 
mental changes in educational settings dealt with the development and 
formative evaluation of an undergraduate peer helping program "The 
results of the study indicated that the final peer helping program, de- 
signed through the action/reflectipn methodology of formative re- 
search, was able to facilitate increases in ego development as measured 
by the Loevinger Sentence Completion form" (Exum. 1979, abstract) 
in this regard. Exum's results parallel the more extensive investigations 
on the teaching of moral development through psychological education 
which are summarized by Mosher and Sprinthall (1978) The gains 
in ego development also parallel those in the Loevinger ego develop- 
ment scale which have already been presented in discussing Miller- 
Tiedeman's work m the teaching of decision making in secondary 
school. It appears that ego development actually does develop and 
that decision making (formative evaluation) and Instruction in moral 
development are ^w\e of the means by which its staged advances can 
be facilitated. 

We conclude this discourse on ripples in the currently calm pond of 
the deep structure of career development theory with a bad pun With 
ail of us It s now think or spin — in the pond of the deep structure of 
career development theory. On the one hand, we must individually be 
scientists at heart and think in our career or let career development 
happen and ceaselessly spin m the occupational roles others make for 
us for the re5t of our liveis. For either you shape the role or the role 
shapes you. 

Erich Fromm (1947) defines ethics as the applied science of the art of 
living. For us. career plays the role of ethics in Fromm's construction 
By substituting decision for choice in»the deep structure df career 
development theory we s.ucceed in making the personal career the 
applied S9ience of the art of living. The applied science is to know the 
necessary, to comprehend the sufficient, and to comprehend compre- 
hension as cooperation with evolution in the novy of our life career 
developments. 
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INTRODUCTION 

The purpose of this section is to provide- a descriptive review of recent 
research relating to employrrtent and training (E&T) programs sponsored 
by the U.S. Department of Labor. The section co-editors presume that 
' research includes development. Therefore, both research and develop- 
ment activities are ^considered and jjjscussed. The review has been 
limited to reflect only those research activities sponored by4he Employ- 
ment and Training Administration of the U.S. Departmervl of Labor 
(QOL). E&T is the contemporary term and acronym used to oenote the 
U.S. Department of Labor's activities which address the concerns re- 
lating to unemployment and underemployment in the laborlorce. The 
current legislative authorization for DOL outlines the E&T charge. "To 
assist the Nation in expanding work opportunities and assuring access 
to those opportunities for all who desire it . . (Public Law 9^203, Title 



\ III, Part B, Sec. 311. (a)). The term "Manpower" was used from the early 
1960's until 1975 to describe essentially the same activities. In 1975 the 
DOL designated that the term "Manpower" be changed to "Employment ^ 
and Training." The recency of the change required that this review treat 
the terms as synonymous. Funds lo support the E&T research and de- 
velopment projects are awarded under authority of several legislative 
acts. Comprehensive Employment and Training Act (CETA) pf 1973 (Title 
III) (PL 93-203). Social Security Act (81 Stat. 888) (Title IV. pt. C, sec. 441), 
and their subsequent amendments. It should be noted that the bulk of 
E&T related research funds flow from the CETA legislation. 

The delimitation for this review should not serve to dimift^sh,the 
importance of the broad scope of employment and training research. ' 
For in one way or another most research can be linked to employment 
or training. The U.S. Departments of Agriculture, Commerce, and De- 
fense have regularly initiated "hnd executed research in this area. In 
addition, these previously mentioned efforts are bolstered by the data 
collection and quasi-research activities of a host of other governmental 
units including employment and security commissions, census bureaus, 
the- Social Security Administration, and agencies related to inter- 
national development and trade. Although data are not available to 
substantiate the scope, one should also recognize the massive con- 
tributions from the private sector. Employment and training research 
I consumers and decision makers should therefore consider the scope 
and varied context from which E&T research products emanate. 

LITERATURE REVIEW PROCEDURE 

The review of employment and training research was initiated with a 
study of the Department of Labor's document entitled, Research and 
• Development Projects. This publication has been issued annually for 
eight years. It summarizes the projects funded by the Office of Research 
art'd Development (ORD) of the Employment and Training Administration 
(ETA). The 1978 Edition contains all projects active on September 30, 
1978 and those completed during the previous three years. Project 
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summanes are provided for projects completed during the previous 
year. A similar approach was used in the earlier editions of the docu- 
ment. The section cq-editors found the document, Research and 
Development Projects to be quite useful in determining the interests, 
scope, and research technology commonly sponsored by ORD Each 
project entry includes the research title-, institution of brigin. grant/ 
contract number, status of project, and project directoV Projects in 
progress or completed during the past year are described by a two or 
mree paragraph summary and a list of approximately five descriptors 
Complete project reports can be obtained from the National Technical 
Information Service (NTIS), Educational Resource Information Center 
(ERIC), or Government Pnnting Office (GPO). Limited aopies are avail- 
able from the ETA or from the institution of origin 
^ The descriptors from the Research and Development Projects docu- 
ment were coupled with an ERIC Thesaurus analysis to identify 
descriptors for a computer search. An on-line computer assisted search 
was conducted to identify the scope and character of employment and 
training R&D literature. A comparison of the two sources revealed 
similar descriptors. The ERIC search produced journal and periodical 
reports and a small number of studies conducted outside the sponsor- 
ship of the Department of Labor. Nalurally. .considerable overlap of 
research reports existed between ERIC and the Research and Develop- 
ment Projects document 

The computer search Used broad terms, sought availability from all 
ERIC categories, and addressed documents submitted since the ongin 
of the 1966 data base The descnptors reflected both E&T and fvlanpower 
research activities. In addition, the descnptors used were expanded to 
include employment, training, and disadvantagement The latter cate- 
gory was chosen in an attempt to secure representation related to the 
social aspects of CETA, Table 1 provides an outline of the computer 
search structure and reports the unduplicated documents by sets The 

pnnt entnes represent the number of unduplicated documents sub- 
mitted during the past'five years *Set 16 was added to insure that all 
documents within the data base using CETA as a descriptor were 
identified. The recency of the legislation influence was Recanted 

OVERVIEW EST RESEARCH DOL R&D PROJECTS 

The eight additions of Research and Development Projects provided 
a wealth of information about employment and training research The 
documents succinctly descnbed the nati^re of the Department of Labor's 
priorities. The current priorities include funding in six separate cate- 
gones and 20 additional subcategories For the most part, the categories 
represented organizational areas ranging from operational studies to 
the analysis of raw employment data. 

Although it was not specifically stated one could infer that the research 
and development thrust was oriented to the addressing of problems 
perceived by officials of the Department of Labor. Further, there was 
an absence of evidence to support cooperative empl9yment and train- 
ing research among agencies or institutions not within the rubric of 
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On Line Computer Structure and Numeric Hits 
for an Employment and Training Search 



Set 


Items 


Description 


• 1 


524 


Employment Projections 


2 


0 


Underemployment 


' 3 


503 


Unemployed 




42— 








— -Subemploymen^ 


5 


871 


Unemployment 


6 


1029 


^Economic Dlsadvaniagemenl 


7 


1495 


Economically Disadvantaged 


8 


144 . 


Underemployed 


9 


4193 


1-8 + 


10 


216? 


Manpower Development 


11 


1897 


Manpower Needs 


12 


1451 


Manpower Utilization 


13 


625 


Employment Programs 


14 


4911 


10-13/+ 


' 15 


835 


9*14 


16 


165 


CETA 


17 


118 


16*14 


18 


9^1 


15 + 17 


19 


143 


18/£i&?752-999999/EJ 


20 


309 


18/080788-999999/ED 


21 


452 


1^ + 20 



Print 19/5/1-130 
Print 20/5/1-250 



^OL. Table 2 outlines the six broad categories and 20 subcategories 
of DOL E&T research. The 685 active projects within tfie past three years 
are detailed by frequency. 

The DOL sponsored projects were administered through five separate 
contract and grant programs. The dominant program included the 
general R&D projects designed to fund experimental, developmental, 
demonstration, and research activities. These projects are particularly 
suitable for contradting vocational education researchers. A broad and 
flexible format was provided by the Department of Labor. Awards ara 
made to public and private organizations in reaction to a proposal sub- 
mitted by a prospective awardee. Proposals are reviewed by committees 
and negotiated by DOL research staff. A grant or contract to the suc- 
cessful contractee is awarded as the result of this process. T+iis general 

' research program provides funding for projects related to the areas of 
program planning and admin istraiiorj, programs and techniques, the 
labor market, and enonomic and social policies. These categories are 
presented in Table 2. No minimum or maximum time limits or fund limits 
exist for a project funded frpm this program. - 

An institutional grant program is also provided for the development 
of E&T capability at colleges and universities. The program was re- 
structured in 1978 to provide incentives for institutions not previously 
funded. The Qurrent program provides assistance to sixteen institutions 

* with grants planned for a four' year period of time. The institutional 
awards an^ distributed among the ten regions and provide an additional 
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TABLE 2 

Department of Labor R&D Active Projects 
by Operational Categories 
October 1. ISTS-September 30.-1978 



Categories of Projects Frequency 
Program Planning and Administration 

CETA Agency Planning ]^ 
— taborMarket firOther Systems 

Agency Capabilities ^' 

R&D, Evaluation* Planning — L 

61 



Programs and Techniques • • 

Education . ^ 

Public Employment Programs ^ 
Supported Employment 
Training & Apprenticeship ^ 
Upgrading & Job Restructuring » 
Welfare Recipient Programs - ^4 

vWorker Assessment & Orientation ^ 
Other Supportive Service for Workefs/Trainees 7 
Programs for OlHer Unemployed _1L 

107 



Economic and Social Policies 



Foreign Trade and U.S. Investment Abroad 



The Labor Market • 
Labor Force, Labor Market, Labor Demand — General 

Labor Force. Labor Market — Specific Sectors & Cohorts 75 

Employer Practices « 

Worker Altitudes — 5L 



129 

24 
24 



Institutional Dissertation & Small Grant Research Projects 

Institutional Grants }z 
Doctoral Dissertation Grants • 

Small Gr^nt Research Projects — rL 



299 

65 
65 



SIX Special awards to institutions with significant minority enrollments. 
This program is currently funded at an approximate allocation of $2.5 
million artnually. 

A creative doctoral dissertation grants program has been in effect 
since 1965. This program is designed to attract social science students 
to employment and training inquiry while generating new knowledge 
in the area. The current grants must address state and local employment 
an^^ining agencies' R&D needs. The awardee must submit a proposal 
/^STid provide evidence that all course work has been completed for the 
doctorate. The program provides research support and stipends to the 
awardee. The grant must not exceed $10,0O0'and is limited to one year. 
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A small grant researc h projects program has been designed to support 
established scholars in the conducting of four types of projects. The 
project types include inquiry in new fields, examination of new ap- 
proaches from existing disciplines, pilot testing of effectiveness or. 
feasibility, and the synthesis ot current state-of-thp-art. Historically, this 
program has often provided a vehicle for subse(^uent funding of larger 
R&D projects Approved proposal emphasis has generally been focused ' 
upon the innovative, practical, and policy related characteristics of the 
research problem(s). A small grant research proposal must not exceed 
$15,000 for direct costs and is limited to one year with provisions for,a 
one year renewal. 

The fourth and final research program of ETA is designed to foster 
research with an international focus. Research in this area is ad- 
ministered by the Foreign Economic Research Staff or the Bureau of 
International Labor Affairs (SILA). The research is concentrated on the 
impact of U.S foreign trade and investment policies in American labor. 
'No specific time limite or funds limits exist for a project funded in this 
area. 

The computer review containe4 entries that overlapped the DOL's 
Research and Development Projects documents. The search identified 
additional information from journals and periodicals and a very small 
number of projects funded from outside the DOL. This occurrence 
supports the recognized dominance of DOL in E&T in this research. 

A review of the computer assisted search results, as supported in 
Table 1 , produced.sfiveral interesting relationships. The most frequently 
identified descriptor was manpower development. Manpower needs 
and manpower utilization w^fS^also frequently identified. As a contrast 
the descriptors, employment projections, unemployed, employment 
programs, and CETA were used less than one third as frequently. There 
vyas a total of 165 projects that used CETA as a descriptor. 
\ A revieyv of the journal and periodical representation in the ERIC data 
bank produced no journal that was dominant in the publication of 
E&T related research articles. More than 25 journals were used to report 
activities related to employment and training research and development. 
The bulk of articles published related to development activities. The 
extent of research oriented publicati6,ns for employment and training 
must be considered virtually non-existent. 

SUMMARY 

Employment and training research has been defined to include research 
and development activities and delimited to exclude those activities 
outside the egis of the Department of Labor. The projects conducted 
have been codified by organizational demands. The activities related to 
functional areas of policy, forecast, evaluation, demonstration, follow- 
up, and experimental activities. The following articles were chosen to 
illustrate the above mentioned functional areas of research and de> 
velopment in employment and training (E&T). 
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A Description of the National Longitudinal Surveys 



HERBERT S. PARNES 
and KEZIA SPROAT 
The Ohio State University 

Structure and development 
of the nls research project 

The National Longftudmal Surveys 
began early in 1965 when the Office 
of Manpower Policy, Evaluation, and 
Research of the United States Depart- 
ment of Labor contracted with the 
Center for Human Resource of The 
Ohio State University for longitudinal 
studies Qf the labor market experi- 
ence of fbur groups in the United 
States population, men 45 to 59 years 
of age. women 30 to 44 years of age, 
and young men and» women 14 to 24. 
(For convenience, these groups will 
hereafter be referred to as men." 

women,' boys/ and girls." re- 
spectively.^ Under a separate contract 
with the Labor Department, the Bureau 
of the Census was to be responsible 
for the design of the sample, the field 
work, and data processing. 

Since budget constraints precluded 
a sample of the tntal population, these 
four groups were Selected because 
each faces more or less unique labor 
market problems of special concern 
to pohcy makers. For the two cohorts 
of youth, these problems revolve 
around'the process of occupational 
choice, and^ include both the prepa-* 
ration for work and the frequently 
diflicult period of accommodation 
to the labor market when fornjal 
schooling has been completed The 
special problems of the middle-aged 
men stem in part from skill obsoles- 
* cence, fi'om the increasing incidence 
of health problems, and Jrom employ- 
ment discrimination, all of which are 
reflected in declining labor force par- 
ticipation rates and in longer-than- 
average duration of unemployment if 



It occurs. For the women, the special 
labor market problems are those asso- 
ciated with re-entry into the labor 
force after an extended absence by 
married women who feel that their 
children no longer require their con- 
tinuous presence at home. 

THE SURVEYS 

The. initial' plan called for annual in- 
terviews over a five-year period with 
representative samples of individuals 
— SIX interviews with each cohort 
As a resurt of cost considerations it 
vwas decided after the second sur- 
vey of the men to survey the two older 
groups biennially rather than annu- 
ally ^ The_younger groups, because 
of their greater mobility, were to con- 
tinue to be interviewed annually As 
the five-year period drew to a close, 
the relatively low attrition rates^ that 
had been experienced and the wide- 
spread interest that had been gener- 
ated in the data bases led to the deci- 
sion to continue the surveys beyond 



^ The older cohort of women has inter- 
viewed in both 1971 and 1972 in order to 
permit a "Survey at the end of the five-year 
period 

2 Although 'a^^he outset of the study it was 
feared that atlwtton would be a major prob- 
lem, shrinkagelof the samples^has been re- , 
markab^y small For example, in the tenth 
year of survey of the mean (1976). 69 per- 
cent of the original respondents were inter- 
viewed, almost half of the remainder hav- 
ing died and the others having disappeared 
from the sarr^ple as the result of their 
refusal to be interviewed or of the inability 
of Census enumera'tors, to locate them 
The correjsponding com'pletion rates for 
the tenth year survey of the other cohorts 
were 78 percent for the women. 71 percent 
for the boys., and 76 percent for the girls 
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the period originally contemplated 
Upon the advice of an inler-discipli- 
nary panel that was assembled to 
consider the issue, plans were made 
to cover an additional Tive-year perTod 
for each cohort by means of two brief 
biennial telephone surveys and a face- 
to-face interview 10 years after the 
original survey 

During 1976, consideration was 
given to yet another extension of the 
study After a questionnaire survey 
of all known users of NLS data and 
a recommendation by an interdisci- 
plinary panel of experts convened 
by the Department of Labor, decisions 
were reached in 1977 to continue the 
surveys of the four samples for an 
additional five years (so long as attri- 
tion did not become a serious prob- 
lem) and to begin a new fongitudinal 
study of young men and young 
, worsen The latter study was to per- 
nnit a replication of much of the anal- 
ysis made of the earlier co'horts of 
youth and also to help to evaluate 
the expanded employment and train- 
ing progranns for youth legislated 
by the 1977 amendments to the Com- 
prehensive Employment and Training 
Act To these ends, a national prob- 
ability sample was drawn consisting 
of 6,000 young women and 6,000 
young men between the ages of 14 
and 21, with overrepresentation of 
blacks, Hispanics, and economically 
disadvantaged whites. The new sam- 
ple of youth was interviewed for the 
first tinne in early* 1979, and will be 
interviewed annually thereafter. Re- 
sponsibility for drawing the sample, 
conducting the field work, and pre- 
panng data tapes has been subcon- 
tracted by the Center for Hunnan 
Resource Research to the National 
Opinion Research Center (NORC). 

Each of the four original cohorts 
was represented by a .national prob- 
ability sample of approxinnately 5,000 
individuals The samples were drawn 
by the Bureau of the Census f^M 
the primary sannpling units (PSU's) 
that had been selected for the experi- 
nnental Monthly Labor Survey con- 



ducted between early 1964 and late 
1966 ^ In order to provide statisti- 
cally reliable estimates for blacks and 
to pernnit a more confident analysis 
of "dTfTeTences m fabor market ex- 
periences between blacks and whites, 
a sampling ratio for blacks three to 
four tinnes as large as that for whites 
w as-used 



Close interaction and cooperation 
has developed over the years between 
the Center and the Census Bureau at 
every stage of the research, and has 
already begun to develop between 
the Center and NORC. For example, 
staff nnembers of the Center were 
generally present at training ses- 
sions in which Census enunnerators 
were being instructed in the content 
of the interview schedules. In pre- 
tests, and on a number of occasions 
in actual surveys. Center personnel 
were sworn in as special agents of 
the Census Bureau and acconnpanied 
interviewers in order to have a first- 
hand view of how the interviews were 
going. On the other hand, while in- 
terview content was principally the 
responsibility of the Center, the Cen- 
sus Bureau provided valuable advice 
based on their long experience with 
survey instruments. The division of 
function between staffs of the Census 
Bureau and the Center for Human 
Resource Research has necessitated 
continuous and very close liaison. 

RESEARCH DESIGN 

Longitudinal Surveys 

Before proceeding with a specific 
description of the NLS research de- 
sign, it IS well to say a few words In 
general about the nature and the 
uptque capabilities of a longitudinal 
study. The essence of Ipngitudi^al 
research Is that it Is based upon 
characteristics of the same group of 
individuals at two or nnofe points in 



^ For a detailed description of the sam- 
pling design, see The NLS Handbook (Co- 
lumbus The Ohio State University. Center 
for Human Resource Research. 1979), pp 
5-13 
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time. Longitudinal analysis, there- 
fore, involves either an examination 
of relationships .aqjong characteris- 
tics of these indiviolials in different 
periods or of changes in one or more 
of thefr characteristics over time. Con- 
ceptually, a longitudinal research de- 
sign does not necessitate periodic 
itiirvAyg fimr.P mformattnn rplatma to 



prospects when she reenters the 
labor market after her children are 
in sch(^ol? Cross sectional studies 
can shed little if any light on these 
types of questions. 

Finally, longitudinal data may per- 
mit determination of the direction of 
causation between two correlated 
variables, or may make it clear that 



various periods of the past can be 
collected retrospectively in a single 
survey. Nevertheless, there are ad- 
vantages to conducting periodic sur- 
veys, since they rely less on the fal- 
lible memories of respondents and 
since certain types of characteristics 

— especially attitudes — cannot reli- 
ably be measured retrospectively. 

A longitudinal research design 
makes possible answers to questions 
that cannot be generated in any other 
way (Parnes, 1972). Perhaps the sim- 
plest and most obvious example lies 
in the quantification of a variety of 
dimensions of labor market dynamics 

— e.g., the extent of movement into 
and out of the labor force, be- 
tween employment and unemploy- 
ment, among f^rms, geographic 
regions, and occupations. .Cross- 
sectional studies taken at two points 
in time permit a measure of the net 
changes that have occurrred in the 
occupational distribution, for exam- 
ple, but they provide no information, 
on the magnitude of the gross flows 
o-f individuals among occupational 
categories that lie behind whatever 
Change m distribution is observed. 

Secondly, longitudinal data pro- 
vide the only means of identifying 
the determining factors in develop- 
mental processes. For example, what 
elements in the high school experi- 
ence of a yisung man affect the 0ase 
od accommodation to the labor ma^r- 
k*t when his full-time education 
ends*^ Are there factors in a man's 
labor market experience during his 
forties and fifties that condition, his 
retirement decision in his sixties? 
How does a woman's employment 
experience prior to marriage or birth 
of children affect her employment 



an ostensible relationship between 
two variables really reflects the in- 
fluence of one or more other vari- 
ables not included in the analysis 
As an example of the first of these 
cases, the cross-sectional relation- 
ship between health and labor force 
status IS welf known. At least in the 
case of men, however, there is some 
ambiguity in this relationship, stem- 
ming from the suspicion that^ eco- 
nomically inactive men may be re- 
porting health limitations in order 
to provide a' respectable excuse for 
their inactivity. A longitudinal anal- 
ysis is on somewhat firmer ground, 
for one can investigate the extent 
to which the onset of a health prob- 
lem in one period leads to a subser 
quent withdrawal from the l,abor 
force Thus we see that a major ad- 
vantage of the NLS IS its longitudi- 
nal nature 

The NLS Data 

It IS not possible to give here a de- 
tailed catalogue of the information 
that has been collected in the NLS 
It will be useful, however, to describe 
the conceptual framework that has 
guided the data collection for the 
four original age-sex cohorts ai 
to delineate the major categoriesi 
variables included ip the studies nr 
the sample of youth that has been 
interviewed for the first time in 1979 
the range of variables will be even 
wider 

Conceptual framework. The general 
purpose of the National Longitudinal 
Surveys is to identify the factors ac- 
counting for variation in the labor 
market behavior and experfence of 
the five subsets (men, women, young 
men and women and youth) of the 
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U.S. population^ represented by the 
samples. Accordingly, the theoreti- 
cal structure underlying the collec- 
tion of data IS botl\broad and eclectic 
An individuals status and behavior 
the labor market ponceived to 
result from an interaction between a 
vartety of characteristics of the indi- 
vidua! and those of the environment 



characteristics, unemployment may 
be expected to be of longer duration 
in a depressed than in a buoyant 
economy The occupational structure 
of job opportunities, the personnel 
policies of employers, and the poli- 
cies of trade unions and government 
may also help to explain variations' 
in the duration of unemployment To 



To illustrate, the length of time an 
unemployed person remains jobless 
IS influenced by both personal and 
environmental circumstances. One 
sgt of relevant personal character- 
istics are those influencing his or 
her attractiveness to potential em- 
ployers, e.gr, education and work 
skills, health and physical fitness, 
sex, color, initiative, appearance, and 
agp. Some of these may be function- 
ally related to )ob performance, 
others may reflect employers' hinng 
preferences tbat have little or nothing 
to do with productivity. A second set 
of personal characteristics that may 
be influential are those that deter- 
mine the range of possible employers 
to whose attention the individual is 
hkely to come. These include the 
extent and quality of labor market 
information, the vigor and ingenuity 
yOf job search, willingness to broaden 
this search outside one s area of resi- 
dence and usual line of work, and 
the individual s hierarchy of prefer- 
^ ences for different types oiwork and 
. different kinds of economic and non- 
economic rewards. Third, the unem- 
I ployed individual s economic circum- 
I stances also condition the likelihood 
I of reemployment. The extent of fman- 
I cial resources, the amount of income 
from sources other than working, 
and the e)itent of. financial obliga- 
tions all affect staying power" and 
thus the subjective requirements 
established for an acceptable job. 

Factors external to the individual 
and his 6r her family also^are influ- 
ential in determining labor market 
experience. Continuing the illustra- 
tion, for any given set of personal 



cite just one example, the higher "Hie" 
level of unemployment insurance 
benefits, the more selective can the 
job-seeker afford to be and the longer, 
other things being equal, is the period 
of unemployment likely to be 

What has been illustrated above 
with respect to unemployment is 
equally appjicable to all other facets 
of labor market experience Whether 
interest centers on labor force" par- 
ticipation, mobi!jtiL_Qr„occupational 
choice, the explanation for the vari- 
ous patterns of behavior or experi- 
ence that are observed is to be sought 
m the relationship between individual 
and environmental characteristics 
An individual makes choices and acts 
in ways that are conditioned by the 
total complex of his or her charac- 
teristics. Behavior is also condi- 
tioned by the individual's perception 
of the environment, but even if envi- 
ronmental factors are misinterpreted 
or ignored, they Impose real con- 
straints upon behavior, and may thus 
produce outcomes substantially dif- 
ferent from what the individual inr 
tended. 

It should be obvious that no single 
study can t»ope to embrace the multi- 
tude of complex variables that are 
,implied by the foregoing paragraphs 
The National Longitudinal Surveys 
focus largely on the supply side of 
the labor market and ask the ques- 
tion "What characteristics of indi- 
viduals are important in accounting 
for variations in their labor market 
status and experience?" fVlany of the 
variables are common to all four co- 
horts, but some are specific to a 
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gtven cohort In the remainder of 
this section the major categories of 
variables are delineated ^ 
Employment and unemployment The 

- extent of labor- market-aptfvfty of-each - 
respondent is measured in several 
different ways. In each survey, ques- 
tions are asked that permit the re- 
spondent s labor force and employ- 
ment status in the preceding week 
to be coded in precisely the same way 
that*it IS in the Current Population 
Survey conducted weekly by the Bu- 
reau of the Census (CPS) For the 
unemployed, a measure of duration 
IS obtained, as well as a specifica- 
tion of methods of job search. In 
addition, information on number of 
weeks of employment and of unem- 
ployment during the preceding year, 
number of hours worked in the pre- 
ceding week, and number of hours 
usually worked on the current job 
IS also obtained A very useful mea- 
'sure of labor market activity that was 
collected in the initial survey of the 
women is the number of years since 
leaving school in which the respon- 
dent had worked for at least six 
months 

Job history The NLS survey instru- 
ments have been assigned to obtain 
a detailed work hisotry of each re- 
spondent over the period covered 
by the study, as well as more limited 
information of this kind relating to 

- the period prior to the initial survey 
The retrospective lifetime work his- 

• tory questions vary among cohorts 
and are more intensive for the -men 
and women than for the boys and 
girls. *Members of each cohort were 
asked at least two series of questions 
with respect to previous jobs For 
the men, the questions related to the 
first job after leaving school and the 



* For a more complete listing and more 
detailed description of the variables, see 
The NLS Handbook (Columbus The Ohio 
State University. Center for Human Re 
source Research. 1979). pp 16-46 



longest job ever held, for the women, 
the pattern of questions varied de- 
pending upon marital and child-bear- 
ing status To illustrate, married 
wjHnen. w h Ojli ad n ever b o rne chil- 
dren were asked to describe tTiree 
jobs, the longest between leaving 
school and date offirst marriage; the 
longest between time of marriage 
and birth of first child, and the 
longest since birth of first child 
Boys and girls were asked about 
their first fgll time job and the job 
(if any) held during, their last y^ar 
in high school In all Instances, job 
is defined as a continuous period of 
service with a given employer or in 
a self-employed status Information 
IS obtained on length of service in 
the job and on the reason for having 
left it. Also, questions are asked that 
allow the job to be classified* by 
occupation, irrdustry, and class of 
worker. 

The work history obtained for each 
respondent over the period covered 
by the surveys is fairly' detailed In 
each survey, respondents are asked 
questions identical to those used in 
the CPS relating to current or most 
recent job, which permit coding of 
occupation, industry, class of worker, 
weekly hours, and location. In addi- 
tion, information is obtained on wage 
rate and. in some of the surveys, on 
union status., These data, together 
with information on jobs held be- 
tween survey dates, permit analysis 
of interfirm, occupational, inter- 
industry and geographic mobility 
Socioeconomic and educational vari- 
ables A large number of character- 
istics relating to the socioeconomic 
status of respondents and to their 
health, education, and training have 
been collected. In the initial survey 
of each cohort, information was ob- 
tained on a number of aspects of the 
"early background of the respondent, 
e g., 'nationality, educational attain- 
ment of parents, and family structure 
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when the respondent was a teen-ager. 
Data on respondents educational 
attainment have been obtained for 
ail of the cohorts, in greater detail 
for the two groups of youth than for 
the men and women. As a minimum, 
highest year of regular school com- 
pleted and type of high school cur- 
riculum have been obtained for all 
cohorts. In addition to this informa- 
tion on formal education, questions 
have been asked in every survey on 
the extent, character, and duration 
of training outside the regular school 
system 

For the youth, information on cur- 
rent school enrollment status has 
been obtained in each survey, this 
information taken together permits 
analysis of the ijndjvidual's movement 
into, out of, ana through the formal 
educational system over the period 
covered by the study Field of spe- 
cialization in college, and amount 
of scholarship aid m college are 
illustrative of the additional types 
of information available for the boys 
and girls An index of high school 
quality 'has been constructed, based 
on information from questionnaires 
sent to the last high school attended 
by each respondent Similarly, jnea- 
sures of thQ quality of higher edu- 
cation obtained by the respondent 
have been derived from a variety of 
published information about the 
coJIege or university attended 

In the initial survey of each co- 
hort, and periodically thereafter, 
the subjects were asked whether 
health problems or physical condi- 
tions prevented them from working 
oc limited the amount or kind of 
work they could do A considerable 
amount of Information has also been 
collected in each interview abput 

' the family charactenstics of the re- 
spondent Current marital status has 
been obtained in every survey; In 

' additron, a retrospective marital his- 
tory was obtained in the initial survey 
of the women In each survey, ques- 
tions are asked relating to all mem- 
bers of the respondent's family who 



live in the household, including re- 
lationship to the respondent, age, 
educational attainment, and (for per- 
sons of working age) number of 
weeks worked during the past twelve 
months, usual number of hours 
worked per week, and occupation of 
longest job. Additional information 
relating to family members includes 
health condition of spouse, number 
of dependents, and whether parents 
and parents-in-law are alive For em- 
ployed womien and girls with chil- 
dren, information has been collected 
on type and cost of child care ar- 
rangement. For those unemployed ^ 
or out of the labor force, questions 
have been asked about the need for 
child care should Ihe respondent find 
a job or decide to work outside the 
home. i 
Financial charactensticsr DeiaWed in- 
formation on the wealth and income 
of the subjects and their families has 
been collected over the several years 
Covered by the surveys, although the 
degree of detail varies somewhat 
among cohorts. Using the initial sur- 
vey of the men as an example, ques- 
tions were asked about the following 
types of assets and liabilities home 
ownership, farm, business or profes- 
sional practice, other real estate, 
automobile{s), savings or checking 
accounts, U.S. savings bonds, seV- 
eral other forms of financial assets 
and several types of debt. Informa- 
tion was obtained by using the ini- 
tial survey of men on the amount of 
income received by the respondent, 
his spouse, and other family members 
from all sources. 

Social psychological variables. A 
number of social psychological vari- 
ables have been used, some uni- 
formly in all four cohorts and others 
only for one or two groups. Attitudes 
toward current job have been mea- 
sured for all four cohorts. These 
include a measure of attachment to 
current employer based upon re- 
sponse to hypothetical job offer 
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elsewhere, and an exploration of fac- 
tors liked best and least about cur- 
rent job. 

The surveys have also attempted 
to tap a variety of attitudes toward 
work m general. For example, re- 
spondents have been asked whether 
they would continue to work if by 
some chance they were to get money 
to live comfortably^ without working. 
They have also been asked what is 
more important to them about a job 
wages or liking the work In each 
interview non-employed workers have 
been asked the circumstances under 
which they would take a job For 
all cohorts there have been questions 
designed to elicit views about the 
propriety of labor market activity by 
mothers of young children. Each sur- 
vey of the men has included ques- 
tions relating to retirement plans 
and expectations 

In every survey of trfe boys and 
girls, questions have been asked 
concerning educational and occupa- 
tional aspirations, and in the initial 
interviews with these groups, atti- 
tudes toward school experience were 
explored For these two groups, 
scores on mental ability tests were 
obtained from the last high school 
attended by each respondent A 
labor market information test has 
been administered to all the young 
people. 

An abbreviated form of the Rotter 
Internal-External Scale has been ad- 
ministered twice, over a two- or three- 
year interval, to each of the four sam- 
ples This scale purports to measure 
perceived "locus of control," ie . 
whether an Individual believes that 
he IS master of his own destiny (inter- 
nal) or^that what happens to Him , is 
determined largely by forces over 
which he has little or no control 
(external). 

Environmental variables Although the 
National Longitudinal Surveys have 
focused largely on the supply rather 
than the demand side of the market, 
there are nevertheless several envi- 
ronmental variables that have been 

er|c 3 



developed on the basis of the char- 
acteristics of the local area in which 
the respondent resides. These vari- 
ables, in all cases derfVed from 
sources other than the survey instru- 
ments themselves, include the popu- 
lation size of the local area, local 
area unemployment rate, an index of 
demand for female labor, an index 
of demand for teen-age male labor, 
and the presence and type of ac- 
credited colleges in the local area 

THE NLS AND PUBLIC POLICY 

There is no way of sjumnffarizing 
briefly the fmdmgs based on the NLS 
data, "Since they are contained in 18 
monographs published by the Employ- 
ment and Training Administration of 
the U.S, Dpartment of Labor and 
over 350 additional articles, theses, 
and monographs prepared by the 
staff of the Center for Human Re- 
sources Research and researchers 
throughout the country. It is perhaps 
sufficient to say that many of the 
findings have produced better and 
more confident understanding of the 
way in which labor markets operate 
and of the factors associated with 
successful educational and labor mar- 
ket experience Thus,, in this indi- 
rect and subtle way the studies have 
constituted a valuable contribution 
to policymakers as well as to re- 
searchers. 

Perhaps the most exerting research 
opportunities and the most valuable 
potential contributions to public pol- 
icy Will come when the data from the 
new youth survey become available 
This survey has been designed to 
permit more sophisticated evaluation 
of publicly-funded training programs 
than has hitherto been possible It 
provides oversample^s of populations 
most likely to enroll heavily in pro- 
grams sponsored by the Comprehen- 
sive Education and Training Act 
(CETA) in order to assure statisti- 
cally valid conclusions about their 
experiences The subsequent labor 
market experienW^ oi CETA pro- 



gram graduates will be compared to 
those of similar youth who were eli- 
gible but did not participate. In these ^ 
analyses we will be able to control 
statistically for such important vari- & 
ables as fannily background, ability, 
motivation, etc.; this will permit us 
to learn whether and to what extent 
employment and training programs 
have been successful and who does 
well in them. Differences in employ^ ^ 
ment and earnings according to race, 
sex, and culture will be measured in 
order to find the extent and causes 
of labor market discrimination. Com- 
parisons with data from the two older 
youth cohort^ will be made, and it 
^s expected that several differences 
will appear between the labor market 
experience of young people who be- 
g€H3 employment in the late 196P's 
and the early 1970's and those who 
are starting out in the late 1970's and 
early I980's. 
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Nonexperimental Evaluations of Employment Service 
Influence on Searcli Times and Earnings 



ARNOLD KATZ 
University of Pittsburgh 

The goal of improving the )Ob-match- 
ing process has been a consistent 
aim of the Federal-State EmployrT\enl 
Service (ES) since its inception with 
the Wagner- Peyser Act of 1933. To- 
day, with an expansive network of 
about 2400 loc^l offices and an an- 
nual budget of over $500 million, the 
ES has become one of IMeNqnost vis- 
ible and important of the nation s em- 
ployment programs In view of this, 
it IS disconcerting that so little is 
known of the actual impact which the 
ES ^has had on the lives of Us job ap- 
plicants. Yet, there are ma|or diffi- 
culties to be overcome if we are to 
increase our understanding This 
paper reports on the findings of some 
recent research on ways of improv- 
ing the methodology for evaluative 
studies of the ES 

The major objectives of the rj^ 
search to be summarized v\jgre 
1 To analyze the conceDinal issues 
in isolating the contjlc^tions of 
the ES. if any, to redticing the un- 
•employment of ES applicants. 
2. To explore methods of estimating 
the cqntribulions of th^ ES to the 
earnings of 1I3 individual appli- 
cants. . 

3 To determine the feasibility of'esti- 
mating these and other related 
influences of the ES from experi- 
mental data sources 
The study looked primanly at two 
•^f ll^ta bases The first of these, the 
'^1972 BLS Jobfinders Survey (JFS). 
IS an encompassing household sur- 
vey of job search experiences. A 



V 

large number of observations, com- 
bined with a detailed view of the 
search activities in which persons 
looking for work become .involved, 
made this a promising vehicle for ex- 
amining what might be learned about 
the ES from household survey data. 
The JFS was used primarily to see 
what such data can tell us about thB 
ES contributions to reduce searct) 
times, and through this, to individual 
applicant's expected lengths of un- 
employment. 

The second data base^ was amal- 
gamated from the Employment Ser- 
vice Automated Reporting System 
(ESARS) and Continuous Work-Bene- 
fit History (CWBH) files of the Pennsyl- 
vania Department of Labor. Both 
ESARS and CWBH contain adminis- 
trative records similar to those main- 
tamed by the Employment Service 
in many states. ESA'RS records „the 
specific services provided to ES ap- 
plicants in each fiscal year CWBH is 
a longitudinal sample of payroll 
records of the firms which pa'y un- 
employment insurance taxes By lick- 
ing ESARS witti CWBH. we were able 
to examine how'lhe specific services 
listed in ESARS were related to be- 
fore and alter earnings extracted 
from the CWBH 

Household surveys, like the JFS, 
and administrative records, IlkQ the 
amalgamated ESARS-CWBH. pro- 
vide nonexperimental msights into 
^the influences of the ES. Nonexperi- 
mental data have the advantage that 
they tend to mirrt)r real-life expeh- 
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ences, and yet real-life experiences 
are not ^necessarily the most useful 
for evaluative research Their major 
limitation is the difficulty of finding 
the appropriate companson groups. 
ES applicants, for example, tend to 
differ from .other )ob searchers and. 
most importantly, their reasons for 
using the ES are often highly corre- 
lated with these characteristic dif- 
ferences. Specifically. ES applicants 
have greater difficulties in finding 
""jobs, their use of the ES often being 
an index of an inability to locate work 
in other ways. This introduces a seri- 
ous selection bias into comparisons 
of ES applicant experiences. How 
does one separate the part due to 
intrinsic personal characteristics from 
the ES contnbution'^ 

In principle, an idealized policy 
experiment in which services are 
randomly denied to otherwise quali- 
fied applicants could be used to con- 
trive appropnate comparison groups 
Such experiments, in essence, doc- 
tor real-life by sorting subjects" 
into categories that can be more 
meaningfully compared. A recent 
attempt by the Stanford Research 
Institute (Johnson. Weiner, Hall. 
Brent. Munson and Coon, 1979) to 
conduct an ES policy experiment en- 
countered major legal and pragmatic 
obstacles and had to be abandoned. 
Where policy experiments have 
proven more practical, as in the neg- 
ative income tax tests, the costs of 
the experiments have proven ehor- 
\ mous (Pechman and Timpane. 1975). 
Given these limitations, there are 
many questions that simply cannot 
be addressed through policy experi- 
ments. As a practical necessity, pol- 
icy evaluations must usually make 
do with nonexperimental data, which 
is'why our research concentrated on 
methodologies for dealing with data 
of this kind 

INFLUENCES OF THE ES ON TIME 
SPENT IN JOB SEARCH 

Suppose that one could compare the 
search times of a group of randomly 
selected job applicants of the same 



race, education, skills, usual weekly ' 
earnings, and numerous other traits 
The data available through the JFS 
permitted us to do just that Our 
initial findina was that persons apply- 
ing to the ES take longer on the 
average to find a job than persons 
with the identical observable charac- 
tenstics who never apply What Is the 
meaning of this resulf? 

Possibly, It is an intended outcome 
of ES programs Some persons are 
intimidated by the prospect of being 
without work and accept le^s desir- 
able positions than they might be 
able to find with a. more intensive 
search Insofar as^ the ES bolsters 
the optimism of individuals in this 
category. XYie mean search of ES ap- 
plicants might well be longer than 
the average, with good results for 
the applicant and the overall labor 
market as well. 

We suspect, however, that individ- 
uals' attitudes toward their job pros- 
pects are more symmetrically distrib- 
uted Overall, as many applicants with 
overly-optimistic as with overly-pes- 
simistic attitudes towards their job 
chances seem likely to turn up a8^ES 
applicants. Hence, M Is doubtful that 
one could explain our finding, which 
applied, across the board to all cate- 
gories of applicants, on such gTounds 
It seems likelier that our careful 
standardizations were unsuccessful 
because the very act of applying to 
the ES is related to intrinsic behavior 
patterns of job searchers We find, 
for example, that jobs filled through 
the ES are systematically lower-paying 
and less attractive than the jobs found 
in other ways by applicants with equiv- 
alent training and experience This 
bears out a widespread feeling that 
the best openings 'are rarely listed 
with, or filled by referrals from, the 
ES. To the extent that this is common 
knowledge, it is bound to have a 
highly significant influence on the 
behavior of job hunters Although 
the cost of inspecting ES listings is 
normally low. the cost of following 
them up may be substantial. The low 
expected return therefore probably" 
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discourages an extensive use of the 
ES in the early stages of a job hunt 
There is an understandable ten- 
dency to use the ES more extensjvely 
later on as a "back stop, " once an 
applicant's more promising sources 
of information have been exhausted. 
This tendency means that persons 
likeliest to have come through the 
ES are likeliest as well 1o have been 
searching longer than other appli- 
cants. 

Many of our other findings are con- 
sistent with this interpretation. Ab- 
stracting from the persons receiving 
unemployment benefits and who thus 
were required to register yvlth the 
ES. the propensity to apply to the ES 
was very low, seldom rising to more 
than a quarter of the eligt,ble appli- 
cants in most population groups. 
This IS a low usage rate considering 
that ES services are provided without 
fees It is consistent with the back-up 
role since most searchers either give 
up looking or find acceptable em- 
ployment within a month The group 
attracted to the ES as a contingent 
information source would necessarily 
be small Moreover, we found that 
on-the-job searchers (applicants who 
began to search while still employed) 
made very little use of the ES unless 
they lost their jobs and became un- 
employed Of all the searchers who 
did use the ES. more reported using 
It as a secondary source of informa- 
tion after relying in the first instance 
on some other way. 

As there is no doubt a large ele- 
ment of chance in the search for 
work, the circumstances that de-< 
cided who applied to the ES are diffi- 
cult to track m the "backstop" case 
This could explain-why we discovered 
the search experiences of outwardly 
similar persons to differ, on average 
The selection process tends to lead 
the unlucky to the ES. The more for- 
tunate find jobs via other routes. The 
differences between the lucky and 
the unlucky applicants of given skill, 
experience, etc. depend on attributes 



that are extremely difficult to detect. 
They may in fact "be inherently un- 
observable. 

If It were possible to perform an 
experiment, the biases of the selec- 
tion process could be averted by in- 
tercepting applicants at the point at 
which they applied to. the ES, or by 
limiting the evaluations to samples 
of the unluckier searchers As this 
IS impossible with nonexperimental 
data, it is necessary to find some way 
to control for the influence of the 
unobservables which explain the in- 
trinsically longer search times of 
many ES applicants. 

Suppose, for example, that search 
IS a "fair" gamble* for the population 
at large. We may then assume that 
the unobservables add an^Tnlerval, 
let us call it u, to everyone's search 
that shortens search time for some 
(u <^ 0), lengthens it for others (u ^ 0), 
but whose overall effect is normally 
distributed with the plusses and mi- 
nuses offsetting (E(u) t 0). The selec- 
tion process, on the other hand, is 
anything but symmetric. Everyone 
whose search takes longer than ex- 
pected, say by some amount u*, ap- 
plied to the ES. Theuaverage unobserv- 
able for ES applicants is therefore 
u2, while the average for the others 
IS u1 The difference between u2 and 
u*1 IS the sample selection bias, or 
the amount by which the search times 
of outwardly similar applications can 
be expected to differ, depending on 
their use of the ES Our technique 
imputes this u2 vs ulj^fect from the 
divisions of the norrnaVlistribution 
implied by the usage p_^i o 

the relative frequencies of cases to 
the ri^ht and left of u*), which can 
be observed/ (See Katz, 1977, 1978. 
and 1979 for a fuller explanation of 
these techniques. The approach taken 
infers the values of u* from economic 
theories of job search ) 

The evaluatic^ns m our study were 
based on the report? of white male 
job applicants who were not ^ceiv- 
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ing employment benefits and who 
thus could be considered to have 
applied to ^he ES voluntarily. After 
making adjustments of the kind just 
outlined, there was impressive evi- 
dence that use of the ES reduces the 
time spent in search. With appropri- 
ate allowance for the "backstop" 
effect, search times were on the order 
of 10 to 20 percent shorter than might 
have been expected if the group, as 
a whole, had been deprived somehow 
of access to the services of the ES. 

We were able to identify as well 
categories of applicants who were 
likelier than others to have used the 
ES as a backup. These consisted 
mainly of on-the-job searchers, per- 
sons who had left a previous job 
voluntarily, new entrants, and reen- 
trants to the labor force. All of the 
shortening of search time that we 
could obsei^ve was concentrated in 
this group, who made up about two- 
thirds of ES applicants. Thus, the 
backstop effect appears to have 
been highly significant and the source 
of most of what the ES does to reduce 
the time spent in research. 

Somevvhat more tentatively, we dis- 
covered t'hat the ES may'actually have 
lengthened the search times of dis- 
advantaged searchers who were liv- 
ing in poverty areas and typically 
employed in low-wage jobs. Though 
the interpretation of this finding is 
not completely clear, this is a dis- 
tinctive group with decidedly pessi- 
mistic expectations about their job 
prospects. It may be that thQ ES 
sometimes bolsters their expectations 
with tentative commitments to pref- 
erential referrals of those who are 
willing to wait for the right situations 
to develop. 

INFLUENCES OF THE ES ON 
INDIVIDUAL EARNINGS 

the savings-in search time which we 
observed seem to have been brought 
about mainly by the willingness of 
unsuccessful searchers to accept less 
attractive offers, more readily avail- 
able through the ES, as a condition 



of returning sooner to work This natu- 
rally raises the issue of whether reduc- 
tions in pay in accepting ES positions 
are worth the earnings losses avoided 
by searching for a briefer time,. The 
ESARS-CWBH date therefore comple- 
ments the search time study by giv- 
ing us Insight into how the earnings 
changes of ES applicants compare 
' with the ES influences on the lengths 
of job search. 

The study of earnings through the 
ESARS-CWBH had to be put on a 
somewhat different footing than the 
investigations of search time because 
the ESARS-CWBH is restricted to ES 
applicants The investigations of ES 
influences on earnings were carried 
out, therefore, by' looking into how 
the earnings experiences of applicants 
receiving^ specific services compared 
to nominal applicants who, though 
they registered with the ES, were 
either offerecf or found uninterest- 
ing prospects and so ended up ac- 
cepting no specific services More 
concretely, we compared th^earnings 
experiences of'white males either 
placed or referred by local offices 
of the Pennsylvania ES In the refer- 
ence fiscal period 1972-73 with the 
earnings experiences of a compa- 
rable group of nominal applicants in 
the same period. Our inferences re- 
garding the comparative outcomes 
for the two groups are based on the 
estimated changes in earnings, re- 
lating the pay received over a period 
of 12 to 18 months fallowing the 
application period to earnings i,n the 
two year inten/al before applying to 
the ES. * 

Here again, there are serious prob- 
lems of selection bias because the 
comparison groups are hardly chosen 
at random. The biases, that affect the 
earnings comparisons are even more 
difficult to analyze than in the search 
time example. In the search time case. 
It was fairly clear that the observed 
search times of ES applicants would 
be longer than the search times ob- 
served of other applicants because of 
the "backstop" effect. In this case. 
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earnings changes of both placements 
and referrals tend to be inflated if 
applicants act in their o\yn best in- 
terest, that IS, nonfimal applicants 
being worse off in accepting ES 
offers, and vice versa. This is a fairly 
typical example of the problems that 
may be encountered in using nonex- ' 
perimental data. Since the subjects 
choose their own categories, it is 
usually difficult to predict the extent 
of the bias Applicants placed or re- 
ferred may have wound up with either 
greater or jesser improvemerjts in 
earnings than the nominal appli- 
cants The differences between their 
observed earnings changes are 
simply not indicative of what we 
might reasonably expect to have hap- 
pened had the ES placements been 
forced to switch places with the 
nommal applicants, or conversely 
Yet the implications of such role 
reversals are'precisely what we want ^ 
to know for programmatic evalua- 
tions, if 

Roughly s'imilar tecliniques, as were 
sketched out for thje* study of search 
times, were applied here as well as 
to impute the unobserved experi- 
ences that we wanted to estimate. 
Administrative records omit a variety 
of information about detailed per- 
sonal traits that can often be ob- 
tained through a household survey. 
This puts a greater strain on the ad- 
justment techniques and may have 
reduced their effectiveness. We also 
ran into problems m matching indi- 
vidual earnings records since, in 
certain cases, it was necessary to 
pull together reports on the same 
individuals over a five y^a^^eriod 
forjhe requisite pre-application and 
post-applic^tion comparisons Indi- 
vidual identifiers in ESARS and 
CWBH appear not to have been as 
carefully edited as needed because 
these data are rarely used in match- . 
mg studies of this type. Notwith- 
standing, the results obtained were 
highly plausible, though it should be 
remembered the findings are explora- 
tory and restricted to Pennsylvania 



Perhaps our most important find- 
ing, true whether the data were ad- 
justed for selection* biases or not, 
is that ES placements and referrals 
appear to cha/inel al^plicants to more 
contmuoua^mployMTient thari nomij/|^ 
nal applicants were likely to have 
found. for themselves The ESARS- 
'CWBH data confirm .that the wage 
rates paid in ES jobs ar^ lower, but 
the loss in wages is almost fully 
offset, on average, by the gam in 

annual eacnings wbichucesyjts from . ^ 

the improved stability dlWnploym?hf 
This IS iTTiportant because it' implies 
that if the findings from our national 
data can be validly related to the 
Pennsylvania experience, the value 
of the earnings losses avoided by 
the average estimated savings in 
search time are significantly greater 
than the modest losses in annual 
earnings estimated .for Pennsylvania 
ES applicants. The net benefit, in 
other words, of the ES contribution 
to search times appears to be signifi- 
cantly positive 

Among our other findings, we dis- 
covered that the earnings reports 
often made it appear as if the experi- 
ences of applicants placed or referred 
were more favorable than they turned 
out to be once the corrections for 
selection biases were applied. In 
every case examined, the administra- 
tive reports overstated the earnjnqs 
gams, or understated the earning 
losses, attributable to ES placements 
and referrals in comparison v^h the 
corrected estimates. As explained 
before, it is extremely difficult to 
predict beforehand whether this may 
be true, but the perils implied in tak- 
ing nonexperimental data at face 
value should be self-evident 

Once the proper adjustments for 
unobservable outcomes had been 
made, it was possible to project what 
the earnings experiences of the noml- 
^rial applicants might have been had 
they been offered and/or accepted 
ES offers, and to do the same for 
placements and referrals, projecting 
their experience with sources out- 
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side of the ES The results confirrfied 
that applicants in either group acted 
m their own best interests, choosing 
the alternative with the higher per- 
'[\ sonal payoff. The .projected experi- 
ences o,f nominal applicants, had they 
accepted ES offers, were particularly 
adverse by comparison with their 
actual earnings, which may imply 
that extensions of current ES ser- 
vices to wider groups would be un- 
advisable The findings must not be 
interpreted to mean the ES does not 
contribute to earnings. Those placed 
or referred fared significantly better 
with ES help than m the projections 
without. 

Time did not permit us to fully 
utilize the ^i/ealth of potentially inter- 
esting evaluative data in the ESARS- 
CWBH files It might have been highly 
productive, for example, to have 
studied the earnings changes ofiother 
applicant groups, those receiving 
counseling and testing or other ser- 
vices, for example. We would also 
have liked to compare the results 
for men and women, using our tech- 
niques Shulenburger, Krieder, and 
Pichler (1979) have now put together 
a similar data file for Kansas, and we 
anticipate that others will be follow- 
ing suit. This IS an encouraging de- 
velopment The information gathered 
through these reporting systems can 
provide more useful data for moni- 
toring programs on a continuous 
basis at a reasonable cost We also 
anticipate that the quality of these 
data will greatly improve with more 
frequent use. The more researchers 
who are laboring to realize the poten- 
tial of these reports, the fuller the 
understanding we may achieve of 
what consolidations of the ESARS 
and CWBH reporting systems have 
to contribute to our understanding 
of ES influences. 

CONCLUSIONS 

W Though fundamentally methodologi- 
cal, our research turned up a number 
of substantive evidences of job appli- 
cants benefiting significantly from 



their individual contacts with the ES. 
We were dubious that an exploratory 
study employing techniques still 
under development would yield any- " 
thing of substance at such an early 
stage. There may therefore be reason 
for bullishness over the prospects of 
further progress in nonexperimental 
evaluations of the ES. Of course, this 
IS a question that each researcher 
must decide individually. We hope 
that, within the space constraints, 
the reader has seen a fair enough 
sample of the inferences it may be 
possible to draw' from research of 
this kind. 
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Documentation and Evaluation of CETA^Education Linkage 
Efforts and Activities In the Commonwealth of Virginia 



MAX S. WORTMAN, JR., 
SUZANNE KARSA MURRMAN, 
and NATHANIEL JONES 
Virginia Polytechnic Institute 
and State University 

INTRODUCTION ^ 

Several crucial problems face em- 
ployment and training agencies to- 
day including (a) lack of adequate fa- 
cilities, personnel, and equipment; 
and (b) inadequate curricula for spe- 
cific vocational-technical training pro- 
grapTis. Recent changes m federal 
legislation have forced prime spon- 
sors to re-evaluate program mixes 
and to consider shifting services from 
work experience type programs to- 
ward basic educational and voca- 
tional offerings. These changes are 
most obvious m the Youth Employ- 
ment and Demonstration Project Act 
of 1977 (YEDPA). Renewed emphasis 
has been placed on youth along with 
the role of education m their train- 
ing. Collaborative efforts between 
the Comprehensive Employment and 
Training Act (CETA) prime sponsors 
and local education agencies (LEAs) 
have been mandated in YEDPA. These 
collaborative efforts are closely 
aligned with many educational pri- 
orities of LEAs. especially m view of 
the increased availability of facilities 
and resources due to shrinking stu- 
dent enrollfnents throughout the edu- 
cational system at all levels. Even 
without the mandates imposed under 
CETA (for prime sponsors) and im- 
posed under educational legislation 
(such as the Vocational Education 
Amendments of 1976), cooperative 
efforts clearly must take place in 
order to en'St||^e adequate services 



for youth and adults who are seek- 
ing assistance oi many different types 
in the labor market. 

Since the enactment of YEDPA, d 
number of publications have been 
produced by both the federal govern- 
ment and private organizations to 
familiarize prime sponsors and edu- 
cation With federal mandates in the 
area of CETA-Education coen-dination 
Some materials have proVided m: 
formation on goals, objectives. a>nd 
intent of-the new youth programs 
(USDO.L, 1977), while others have 
described new youth program models 
and innovations (U.S.DO.L,, 1978), 
In a few instances, state level agen- 
cies have-provid^d assistance to local 
educators, human resource planners, 
and others in developing new youth 
programs (Michigan Department of 
Labor, 1977). 

Unfortunately, very few studies con- 
ceptualize linkages between CETA 
prime sponsors and educators. One 
study analyzed cooperative efforts 
under the special Governor's grants 
at the post-secondary vocational edu- 
cation level and focused on the vari- 
ous patterns which individual states 
have devfelopeCI for the disposition 
and utilization of CETA Title I,- five 
percent monies (since these monies 
may provide one of the best possible 
long-range answers for effecting 
CETA-post secondary vocational edu- 
cation program linkages) (Proactio/1 
Institute. 1978). In another study (Cas- 
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/ sell et a! . 1976), six major barriers 
to communication among manpower 
related agencies were identified: 

1. Communication methods. 

2. Confusing and conflicting rules 
and regulations. 

3. Turf. 

4. Information 

5. Planning cycle problems. 

6. Goal incongruence and role con- 
fusion. 

These general barriers to effective 
administration of employment and 
training programs cannot automati- 
cally be assured of applying to CETA- 
Education linkages although many 
^have been shown to be applicable to 
M the CETA-post-secondary vocational 
J M education linkages study Neverthe- 
less, they may be important barriers 
in preventing the effective accom- 
plishment of employment and training 
program goals 

Clearly, studies that identify suc- 
cessful coordinative efforts between 
employment and training agencies 
and educational institutions are badly 
needed (U.S.O.E., 1977). 

Although case studies of success- 
ful programs have been done on 
CETA-Education relationships at the 
local level (U S D O L , 1978), this 
study will investigate both "success 
stories" and examples of coordina- 
tive plans being attempted by prime 
sponsors and educators Special at- 
tention will be paid to mechanisms 
used for successfully carrying on rela- 
tionships that were formed during the 
planning process From the analysis 
of successful CETA-Education link- 
ages, a system will be developed that 
can be used by agencies concerned 
with CETA-Educatlon linkages (CETA 
prime sponsors, educational institu- 
tions, and state agencies) The system 
should be helpful to other state and 
local agencies for coordinating oth^ 
types of non-CETA programs. 



METHOD 
Procedure 

The research project can be divided 
into two stages: (1) the analysis of 
the present linkage system in the Com- 
monwealth, and (2) the assessment of' 
future linkage needs. 
Analysis of present linkage system 
Present linkages in the Commonwealth 
of Virginia can be identified through 
an anaJysis of local programs and 
activities. Documents, reports, sta- 
tistical data and pertinent informa- 
tion dealing with CETA-Education 
linkage activities can be obtained 
from federal, state and local agencies 
and institutions. Federal information 
will be obtained from regional offices 
of appropriate federal agencies. State 
data will be obtained from state agen- 
cies, advisory commiyees, and com- 
missions. Local information will be 
obtained from prime sponsors, bal- 
ance of state regional offices, and 
post secondary and secondary edu- 
cational institutions dealing with 
prime sponsors. Following the return 
of all documents and information, 
an analysis of present linkages in 
the Commonwealth will be initiated. 
Information gathered in this stage 
will be used to develop an instrument 
for on-site interviews at local and 
state levels. 

Before designing the interview in- 
strument,- criteria for identifying and 
determining the constituents of suc- 
cessful linkage(s) will be established. 
ThenMhe instrument will be designed 
to gather specific programmatic data 
and Identify successful linkage activ- 
ities and mechanisms used to over- 
come barriers to program coordina- 
tion. The instrument will focus on 
both objective and subjective mea- 
sures of suctessful linkage(s) includ- 
ing: (1) types of resources available 
for coordination between prime spon- 
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sors and educational mstitutions, 

(2) how these resources are pooled, 

(3) client population served. (4) who 
secures placement for the program 
trainees, and (5) who provides staff 
and training facilities 

In the interview process, heavy 
emphasis will be placed on the iden- 
tification of boundary spanners. In 
this study, boundary spanners can 
be described as those active in the 
Governor s Employment and Train- 
ing Council and local advisory coun- 
cils, individuals acting m a liaison 
capacity between groups of prime 
sponsors and correlated local edu- 
cational agencies and post secondary 
educational institutions, and those 
possessing an outreach role m their 
organizations An equally important 
aspecT Ts Th.The area of prelmkage 
communication between prime spon- 
sors and educational institutions 
These boundary spanners and their 
developmental activities and their 
relationship to successful linkages 
will be emphasized. In this way, the 
degree of dual involvement of CETA 
and education can be studied in 
depth 

To supplement initial documenta- 
tion, investigators will use this instru- 
ment in the field to interview prime 
sponsors, the balance-of-state re- 
gional offices and educational insti- 
tutions having coordinative activi- 
ties These interviews will serve to 
broaden or clarify the initial docu- 
mentation and provide relevant orga- 
nizational, programmatic, and per- 
sonal data for a complete project 
analysis In additionrto these inter- 
'views, any additional reports, docu- 
ments, and other related educational 
needs in the area deemed relevant 
by pnme sponsors and educational 
agencies and institutions will be col- 
lected At this point, the data base 
for identifying effective mechanisms 



for linkages facilitating coordination 
will have been established. 

The data base will then be used to 
analyze selected programs rn terms 
of overall effective linkages. 'Struc- 
tural, operational, planning and pro- 
grammatic processes in the programs 
will be analyzed in detail to identify 
procedures, strategies and interper- 
sonal relationships which are con- 
ducive to successful programs. These 
will be generalized into a guideline 
format containing specific recommen- 
dations. Moreover, these guidelines 
will provide recommendations for ap- 
propriate transferability of successful 
methdds to other employment and 
training programs in Virginia. The 
data and records and the information 
from current CETA-Educatioh linkage 
studtesT wilt be used to develop an 
effective system against which em- 
ployment and training operations in 
other mstitutions and agencies can 
be compared Furthermore, the sys- 
tem can be utilized for the develop- 
ment of innovative projects. 
Assessment of future linkage needs 
During the second stage of the proj- 
ect, a questionnaire will be developed 
and mailed Xo practitioners in the area 
of CETA-Education to solicit their per- 
ceptions ot^pecific linkage needs for 
future planning. Analysis of these 
responses will provide a data base 
for the documentation of future needs 
in CETA-Education cooperation 

RESULTS 

Three results are expected from this 
study of CETA-Education linkages m 
the Commonwealth of Virginia. First, 
an analysis of linkage documenta- 
tion at the state and local operations 
levels will be compiled. Depending 
upon the status of these linkages^ 
within the state, this compilation wilf 
<6e useful to agencies, prime sponsors, 
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programs, and projects interested in 
either comparing or executing linkage 
agreements. 

Second, and more important, a 
descriptive analysis of all current su^ 
cessfui linkage efforts m ttie Co^tv 
monwealth of Virginia will be dbm- 
pleted. Case studies of these efforts 
Will include geographic, demographic, 
structural, operational, and interper- 
sonnel descriptions of the ^program, 
including the participating agencies 
and institutions. Emphasis will be 
placed on preliminary activities lead- 
mg up to contractual arrangements 
and the identification and success 
of boundary spanners. This analysis 
will be based prirT\arily on the mea- 
sure of effectiveness developed m 
the^4aterview instrument A fffcus will 
be on both objective measure such 
as participants served, cost of pro- 
grams, and local demand for skills 
taught to participants, and subjective" 
measures of success, such as coordi- 
nation of efforts by agencies involved 
and innovativeness of programs 
Third, a clarification of specific 
% linkage needs within the Common- 

wealth of Virginia will include the 
identification of necessary areas of 
linkage and an elaboration of their 
status This will provide the neces- 
sary data for long-range pjanning 
purposes in the area of futurle CETA- 
Education llnkage,al:^lyitles^ ^ 

DISCUSSION 

This study has been designed to 
establish the initial groundwork for 
CETA-Education linkages in the Com- 
monwealth of Virginia. Prior to 1977, 
It was generally accepted that the 
speed and means by which the five 
percent special Governor's Grant for 
Vocational Education was imple- 
mented was an adequate measure of 
coordination between prime spon- 
sors and education institutions. This 
assumption is no longer valid. Legis- 
^ lative mandates and funding incen- 
- tives have made linkage activities 
increasingly important to both em- 
ployment and training agencies and 



educational institutions at all levels. 
These mandates and incentives in- 
clude: (1) 1977 Vocational Education 
Amendment, mandating state council 
,^ordination. (2) the Youth Employ- 
mint and Demonstration Projects Act 
OOT979, calling for prime sponsor 
ana local education agency coopera- 
tion and mandating vocational train- 
ing in public service employment, 
and (3) CETA, Title II, Section 202 
(d), calling for state encouragement 
in local level coordination 

The basic question of process, 
being asked by local level agencies 
has not yet been answered. This 
study IS an attempt to deal with the 
question of the linkage process Sev- 
eral integrated efforts have been 
designed to clarify this Hnkage pro- 
cess including: ^ 

1. The identification of. 

a. Collaborative agreements/link- 
ages between ^rime sponsors 
and educational institutions 
providing educational and train- 
ing services to pnme sponsors. 

b. Collaborative agreements/link- 
ages between prime sponsors 
and governmental agencies in- 
volved in employment and train- 
ing activities, i*e., service pro- 
viders, funding agencies and 
technical assistance agencies. 

c. Collaborative agreements/link- 
ages between federal, state and 
local agencies (such as work- 
frig agreements through memo- 
randa of understanding between 
the Governor's Employment 
and Training Council and State 
agencies) 

d Important elements in these 
agreements leading to increased 
•coordination, 
e Crucial variables which con- 
tribute to increased collabora- 
tion which may include: 
1. Policy Linkages, 
ik Planning Linkages, 
* iii. Structural Linkages, 

iv Financial (Budgetary) Link- 
ages, 

V. Programmatic Linkages, 

VI. Operational Linkages. 
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\ Resources available on either 
side and request for coopera- 
tion of all actors with collabo- 
rative agreement to provide in- 
formation (formal and informal) 
on how the agreements were 
achieved. C 
g. Particular or unique-character- 
istics of local organizational, 
administrative and operational 
systenns, which provided the 
background for such coopera- 
tive agreements. 

2. The provision of mformation to the 
Governor's Employment and Train- 
ing Council (GETC) as well as prime 
sponsors, educational institutions 
and o|MeT interested agencies that 
exannines 

a Manpower and education legis- 
lation as It IS related to their 
linkages 

b Alternative ways of replicating 
programs or transferring pro- 
grams to employment and train- 
ing institutions or other agen- 
cies capable of efficient and 
effective delivery of services 
c Strategies for increasing collab- 
orative efforts between CETA 
and Education • 

3. The provision of a long-range 
needs assessment that can be used 
by both resource and service pro- 
viders that will 

a. Determine specific employment 
and training needs in the state, 
b Determine specific linkage 
needs necessary in meeting (a) 
c. Provide an adequate- data base 
for use in future planning 

4. The identification of successful 
linkage efforts in Virginia that en- 
compass effective coordination 
mechanisms as well as an ideal 
system that can be used in a dual 
involvement by educators and 
prime sponsors in achieving the 
optimal use of their funds. 
Although this research will give 

needed insight into linkage activities 
in the Commonwealth- of Virginia, 
future studies in thi3 area must take 
, place. As further linkage activities 



takf place, their effectiveness must 
be evaluated. Research into CETA- 
Education linkages should be an on- 
going activity for maximizing joint 
resources and clientele coverage and 
minimizing service inefficiency and 
duplication. 
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INTRODUCTION 

It is well documented that college 
graduates have long enjoyed an eco- 
nomic advantage over high school 
raduates in the labor market. This 
otion* Is most often supported by 
examining the relative earnings of 
college graduates vis-a-vis high 
school graduates (Becker, 1964, 
Mincer, 1974). But other measures 
of economic position, $uch as occu- 
pational prestige, support this notion 
as well (Blau & Duncan, 1967). In 
general, the literature supports the 
view that a college education is a 
worthwhile investment. 

Recently, however, a nunnber of 
challenges to this view have ennerged. 
Richard Freeman has concluded that 
the labor market position of college 
graduates has deteriorated in recent 
years so that a college degree is only 
a marginal Investment (Freeman. 1975, 
1976). Freennan argues that the earn- 
ings of college graduates have de- 
clined relative to the earnings of 
high school graduates, in part, 
because of the large number of 
college graduates entenng the labor 
market. He concludes, tt^erefore, 
that recent college graduates are 
worse-off than college graduates in 
times past. Yet other researchers, 



also using relative earnings, have 
concluded that college graduates 
have maintained their economic 
advantage, even through recent times 
(Grasso, 1977, Grasso & flyers, 1977).^ 
Freeman has been criticized for 
failing to compare the earnings of 
young, college graduates with those 
of young, high school, graduates 
(Grasso. 1977, Levin, 1977). 2 It is 
difficult to conclude, therefore, 
whether or not there has been a de- 
cline in the relative earnings of 
college graduates in recent years. 

Another challenge to the predomi- 
nant view has been raised by Lester 
Thurow <1974, 1975). Thi^pow posits 
a "job competition" model to the 



^ Actually a number of measures of earn* 
ings are used m the literature. Freeman 
uses both the real starting salaries of 
college graduates and annual income of 
year round, full-time employed men with 
high school or college completion Grosso 
(1977) uses hourly wage rales and annual 
earnings while Grasso and Myers (1977) 
use hourly wage rates. 

2 That is, he compares starting salaries of 
new colleae graduates with the average 
salaries of the experienced labor force 
Grasso (1977) and Levin (1977) rajse other 
criticisms of Freeman's work as 



^ Copyright Russell W Rumberger. 1979 from the Journal of Human Resources, Vol 15 
(forthcoming) ^ * . 
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labor market in which (1) marginal 
productivity is associated with jobs 
rather than individuals (as in the 
neoclassical case), and (2) education 
serves as a means of identifying the 
most qualified (trainable) individuals 
In the face of increases m the supply 
br educated I a b o17 p eTso n^ with more 
education will continue to fare better 
than persons with less education, 
although the absolute position of 
educated workers may actually 
worsen over time as many are forced 
into lower-levef jobs. In other words, 
according to Thurow s view, relative 
earnings between college and high 
school graduates may or may not 
have declined m recent years, yet the 
absolute occupational position of 
college graduates may have deteri- 
orated nonetheless. Again the evi- 
dence to support Thurow s view is 
inconclusive But other researchers 
have offered data that suggest many, 
workers, including both high school 
and college graduates, face a "poor" 
labor market situation because they 
often fail to find jobs commensurate 
with the level of training they have 
received in school (e.g.. Berg, 1971; 
Rowlins & Ulman. 1974), 

The purpose of this paper is to 
examine the economic position of 
college graduates between 19.69 and 
1975 \jsing new data in order to 
test the validity of Freeman's and 
Thurow s views Specifically, two 
hypotheses are tested (1) the eco- 
nomic position of college graduates, 
as measured by relative earnings, did 
not deteriorate appreciably betweerr 
1969 and 1975. and (2) the absolute 
occupational position of college 
graduates did worsen during this 
period when occupational position 
is measured by the degree of utiliza- 
tion of educational skills The second 
issue of occupational position at- 
tempts to measure directly the utiliza- 
tion of education in the labor market 
by examining the general skill re- 
quirements of jobs and contrasting 
them with education (which is as- 
sumed to provide cognitive skills and 



abilities in the labor market) Thus 
It avoids some of the shortcomings 
of an index based on relative earnings, 
which are subject to the imperfections^ 
of the market (Eckaus, 1964) But it* 
too has its shortcomings, as will 
become evident from the discussion 
~m"the'rl6Xt section. ^ 

By using two different measures 
of economic position in the labor 
market, we should be able to deter- 
mine (1) whether ihe economic posi- 
tion of college graduates has wors- 
ened in recent years, and (2) whether 
either Freeman's or Thurow's chal- 
lenge to the predominant view is 
supported by the«evidence 

The remainder of the paper is di- 
vided into three sections The next 
section presents the methodology of 
the study The section following con- 
tains the empirical results In the last 
section, I will draw some conclusions 
based on the empirical findings and 
make some recommendations for 
further research 

METHODOLOGY ' 

Sources of Data and Populations 

To Investigate changes in the eco- 
nomic position Qf college graduates, 
cross-sectional analyses were per- 
formed for two different years 1969 
and 1975 ^ Census data were used 

^ These years represent contrastmg 
periods m the U S economy The year 
1969 marked the end of a decade of rapid 
economic growth while 1975 was a second 
straight year of decline in real GNP Con- 
sequently, there were increases in the 
unemployment ral^s, especially for young 
workers and those with low levels of 
schooling There were also increases in 
labor force participation rales for young 
whiles but decreasing rales for young, 
black males and steady rales for young, 
black females (see US Department of 
tabor, 1977, Tables A-4. A-6. G-3) There 
IS, of course, an inherent weakness m 
undertaking cross-seclional comparisons 
— they can mask trends Nonetheless, such 
comparisons may still provide useful in- 
formation In this case, the years 1969 
and 1975 may represent a high and a low 
point in the cyclical variation of relative 
wages For a comparison with earnings^ 
from Other years, see Welch (forthcom- 
ing) 
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since they are taken from a represen- 
tative sample of the U S population 
and contain information on earnings, 
occupation and industry where em- 
ployed, personal characteristics, 
and other relevant information. 
/ The March 1976 Current Population 
Survey (CPS) was used to evaluate 
the contemporary situation This sur- 
vey, conducted every year, serves as 
a continual source of information 
on the labor market situation by both 
the Census Bureau and the Bureau 
of Labor Stati^ics (U S. Bureau of the^ 
Census and Bureau of Labor Statis- 
tics, 1976) The other cross-section 
was taken from the 1970 1/1000 Public 
Use Sample (US. Bureau of the Cen- 
sus, 1972) These data, a random sub- 
set of the 1970 decennial survey, 
contain similar information to that in 
the CPS However, since the two sur- 
veys were administered differently, 
the data they yielded are not strictly 
comparable * 

From these two surveys I extracted 
the inexpenenced labor force — those 
individuals who have been working 
(employed or unemployed at the time 
of the survey) less than five years. ^ 
Since the Census data do not contain 
years of experience, the variable had to 
be estimated from other data as fol- 
lows 

Years 'of experience = Age - Years 
of schooling - 6 Those persons with 
estimated experience levels between 

* In particular, revisions were made in 
processinq after March, 1975, which in- 
creased Ine reported earnings of col 
lege graduates relative to high school 
graduates See U S Bureau of Census 
(1977) for a descnption of these changes 
and how the CPS data compare with data 
from the 1970 Decennial Census I em- 
ployed the Decennial Census instead of 
, another year of the CPS because the former 
was readily available at the time I con- 
ducted this research. 

^ The census only collects labor market 
information on persons 14 years old and 
older We, therefore, must confine our- 
selves to this group Also excluded' from 
the analysis were those working without 
pay 



0 and five years were included in the 
inexperienced labor force. Obviously, 
this approach is subject to error. It 
assigns years of experience based on 
a normal" progression through 
school. For example, an individual 
who IS currently working at age 18 
with 12 years of schooling completed 
IS assumed to have 0 years of*work 
experience while,, in fact, he or she 
may graduate at age 17 and have 
one year of work experience. Also, 
this method does not distinguish 
between full-time and part-time 
experience. The effects of a year of 
part-time work experience may not 
be the same as a year of full-time 
work experience.'^ In spite of these 
shortcomings, this approach is the 
best available within the limitations 
of the available data. 

The samples contained information 
on annual earnings reported for the 
previous year (i e., 1969 and 1975). 
weeks worked the previous year, 
marital status, sector where employed 
(private, government, self-emrployed), 
years of schooling completed, and 
current occupation, f^ean weekly 
earnings we're calculated by dividing 
annual earnings by weeks worked 
the previous year.^ ^ 

Model 1: Relative Salaried 

The first measure of economic posi- 
tion IS based on relative salaries be- 
tween persons of different schooling 



^ The 1970 Census did not identify whether 
a respondent s principal activity during the 
reference week was working or attending 
school Persons with less than zero years 
of estimated work experience were, there- 
fore, excluded from the samples in order 
to focus the analysis on those individuals 
who were most likely to be full-time labor 
force participants This procedure may 
bias the samples by excluding workers 
who finished school and entered the labor 
market early However, since the samples 
for 1970 and 1976 were selected in the 
same manner and since, primarily, we are 
interested in comparisons between the 
two years, the resulting bias should not 
pose a problem. 

^ For the 1970 data, only interval ranges 
of weeks worked were reported so the 
midpoint of these intervals was used 



levels. It IS a traditional index of 
economic wGll-being" used to mea- 
sure returns to investment in school- 
ing. One of Its shortcoming^ ts its 
failure to capture other pecuniary 
and non-pecuniary returns to school- 
ing (Duncan. 1976. Lucas. 1977[ 
Also, it IS difficult to calculate returns 
to schooling "net " of differences m 
ability or of consumption components 
(Blaug. 1972, Eckaus. 1973) However. 
It IS considered to be the standard 
basis for estimating the profitability 
of educational investment. 

The following earnings function 
is^ posited to explain the relationship 
between earnings and education, con- 
trolling for several other factors ^ 

5 2 

(1)lnW ^ +2/^nXt^+ 



+ e 



K-l 

where W - mean^weekly earnings 
X, - Dummy variables representing 
years of schooling completed, 
with 

I ^ 1 representing 0-8 years 
I ^ 2 representing 9-11 years 
I - 3 representing 13-15 years 
I - 4 representing 16 years 
I -5 representing 17+ years 

E Years of experience 

Y, - Dummy variables representing 
mantal status, with 
j = 1 repres^ting presently 
marned 

J ^ 2 representing previously 
marned 



• Coefficients will show percentage 
differences between any given schooling 
category and the omitted category 12 
years of schooling Actually, it is possible 
to compute relative earnings based on 
either absolute differences in earnings 
or ratios It is absolute differences that 
form the basis for social and private 
investmerrt decisions in education while 
employer demand is based on the ratio 
of relative earnings, as Becker (1964) 
points out Ratios are used here in order 
to make the results comparable with those 
of other studies 



2k = Dummy variables representing 
sector where employed, with 
k = 1 representir>g public 
sector 

t k = 2 representing self- 
employed 

From this earnings Xun_ction. one 
can make compansons between the 
adjusted earnings of persons with 
different years of schooling. One 
can also observe relative changes 
between 1969 and 1975. 

Model 2: Utilization of Educational 
Skills 

The second index of economic posi- 
tion involves measuring discrepancies 
between the educational attainments 
of workers and the general skill 
requirements of the job that they hold 
This index is not new, it has been 
used by others to examine conditions 
in the labor market (Scoville, 1966, 
Miller. 1971, Lucas. 1972) 

But constructing this index pre- 
sents several problems It requires 
information on the skill require- 
ments of jobs, determined indepen- 
dently of the characteristics of workers 
in those jobs. This information does 
" exist in the Dictionary of Occupa- 
tional Titles (DOT), issued by the 
U.S Employment Service (1965) The 
Employment Service periodically 
collects information on the character- 
istics of jobs in the U.S. economy, 
including information on general skill 
requirements (referred to as General 
Educational Development (GED)) 
These requirements are supposedly 
determined solely from the tasks of 
the job and not the characteristics 
of the worker in the job (see U S 
Department of Labor. 1972. Chapter 
5). But It IS by no means a perfect 
system (see f^umberger, 1978. Chapter 
3). For the purposes a| this paper, 
though, we will assume the indepen- 
dence between educational attain- 
ment and skill requirements Another 
limitatioTTDf this approach is its - 
failure >to account for chc^nges irt 
skill redlwirements over time. It is 
reasonableNto assume that the skill 
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requirements of a job rise or fall 
as the tasks of the job change, how- 
ever, such change is unlikely to be 
substantial over such a short period 
The results may understate (over- 
state) the amount of overeducation to 
the degree that the skill requirements 
of jobs' hWe decrea"secJ (mcreased) 
dunng this penod.^ 

For the purposes of this study, con- 
structing the second index necessi- 
tated two tasks (1) assigning appro- 
priate skill requirements of jobs, 
to respondents from the two surveys 
based on their current occupation, 
and (2) translating these requirements 
into equivalent years of schooling. 
The first task was accomplished using 
the April, 1971. CPS Respondents 
in that survey, in addition to being 
coded by Census occupation codes, 
were coded by DOT pccupation codes 
and their corresponding level of GED 
By cross'tabulating Census occupa- 
tion with GED levels, it is possible to 
determine the probability of holding 
a job with a certain GED level given 
one's Census occupation code. From 
these probability distributions, the 
mode GED level was determined for 
each Census code. In most cases, 
this served as a fairly accurate esti- 
mate of GED requirements since mpst 
census occupations were concen- 
trated in one GED category. Respon- 
dents in both the 1970 and 1976 
surveys were then assigned an ap- 
propriate GED level 

The second task involved trans- 
lating GEO levels into 'equivalent 
years of schooling This, too. was a 
difficult task First, years of schooling 
are not homogeneous — they could 
represent different amounts of train- 
ing due to individual variations in 
school performance, courses studied. 



and the quality of the institution at- 
tended Second, GED levels actually 
represent a composite of general skill 
requirements — general reasoning, 
mathematical ability, and verbal ability 
(US Employment Sen/ice, 1965, Vol. 
2, Appendix B). The relationship be- 
tween years of schooling and GED 
levels IS rather unclear. But Eckaus 
(1964) suggested an equivalency that 
was used m this investigation. ^° 

The empirical investigation of 
changes in economic position of 
college graduates was performed 
by constructing an index of years of 
"overeducation" for ^ach respon- 
dent as follows: ' ♦ 

(2) Overeducation (in years) - 
Years of schooling completed GED 
(in years) 

The highest schooling level from each 
GED level was used as equivalent 
years of schooling 

Equivalent Years 
GED Level of Schooling 

1 4 

2 7 

3 10 . 

4 12 

5 16 

6 18 ' 

The following function was then eval- 
uated 

' (3) 0 ^ ^ f 2 (iuK ^ ftE ^ 2 



where 0 ^ years of overeducation 

3ll other variables are as 
defined in equation (1) • 



^ Bear in mind that'to a large degree 
changes in the nature of-)Obs are as- 
sociated with new capital investment The 
shdrl period of analysis and the low 
capital formation in this pe<iod suggest 
minimal changes in job specifications For 
an analysis of the changing skill require- 
ments of jobs, see Rumberger (1978), 



'° Eckaus e'quivalency probably repre- 
sents a conservative estimate A more 
recent Department of Labor publication 
uses lower estimates for equivalent years 
of schooling, than those proposed by 
Eckaus (US Department of Labor. 19^1) 
In this paper, only the results based on 
-the more conservative estimates ard re- 
ported Using other levelfe did not alter 
the direction of the results, just the magni- 
tude Only further research can "^c^jur^teiy 
determine the translation ol GED levels 
into years of schooling 
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This equation estimates years of over- 
education in equation (1) of different, 
schooling levels, controlling for the 
effects of other v^riables.^^ 

RESULTS 

To test the first hypothesis, the coef- 
ficients of equation (1) were 6stinnated 
using ordinary least squares The 
results appear in Table 1 T^e left- 
out dummy variables are: 12 years 



of schooling completed, single, 
and employed in the private sector 

The results mdicata^at, in general, 
the earnings of college graduates did 
not decline relative to high school 
graduates between 1969 and 1975J2 
The relative earnings of white males 
with four years of college declined 
only slightly between 1969 and 1975. 
while those of black males Improved 
significantly. The position of workers 



TABLE 1 

Estimated Earnings for Inexperienced Males by Race, 1969 and 1975 



Schooling 
0-8 Yrs » ^ 
9-11 Yrs 
12 Yrs 
13-15 Yrs 

16 Yrs 

17 ^ Yrs 
Experience Yrs 
Single 
Married 

Previously Married 
P/ivate Sector 
Public Sector 
Self-Employed 
CoiSstanl 

# of Observations 
Mean Weekly Earnings 
Ln Earnings 

Exper Yrs 
Age — Yrs 

i Significant at 10 level 

* Significant at 05 level 
*• Significant at 01 level 



Whites 



Blacks 



1969 


1975 


1969 


1975 


- -1 81" 


-1.79" 


-153" ^ 


- 1 22" 




- 83" 


' 51- 


- 75" 


13" 


05 


08 


06 


43" 


40" 


46 


92" 


65" 


49" 


1 00- 


99- 


•l5" ' 


.16" 


>1" 


18" 










46" 


.43" 


58" 


53" 


29* 


42" 


- 65 


36 


- 04 


- 10* 


- 01 


~ 22 


- 00 


~ 58" 


54 


24 


3 65 


3 98 


3 29' 


3 51 


32 


32 


15, 


20 


7743 


6355 


715 


625 


96 33 


125 06 


70 92 . 


99 65 


,39 


42 . 


-3 4/ * 


39 


2 1 


2.2 


2 3/ 


27 


20 5 


20 8 


19/ 


20 4 



" Levin (1977). m a private discussion, sug- 
gested that equation (3) be rewritten to 
exclude the control variables The equation 
would then estimate the gross relation- 
ship between the two prirtiary variables — 
overeducation and years of schooling — 
instead of partitioning it among the control 
variables Actually a two-step regression was 
run on equation (3) with years of schooling 
introduced in the first step and the control 
variables entered in the second There were 
few differences in theestimated co-efftcients 
of education between the two steps 



'2 Differences bVtween whites and blacks 
will not be addresXed in this paper in orderlo 
concentrate on\he task of examinin^g 
changes between yoars within each group 
In general, differeneds between blacks and 
whites support the notion that whites fare 
better than blacks m Jhe labor market., 
although the differences appear to have' 
lessened during the period under investi- 
gation. ^ 
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with other educational credentials 
remained similar between the two 
yQars, except for the relative decline 
experienced by white males with one- 
three years or more thaii four years 
of college Overall, the, results re- 
ported here suggest that there has 
not been a marked decline in the 
economic position of college grad- 
uates in recent years, at least as 
measureid by relative earnihgs 
^ These results challenge the conteri> 
i \tion of Freeman (1975. 1976) that 
the reTatK^e earnings of college grad- 
uates have been declining m recent 
" years Other results indicate that 
in recent years (1) relative earnings 
have fluctuated, in part, because of 
business cycles, and (2) large in- 
creases in the number of young 
workers entering the labor market 
have depressed the earnings, of 
all young workers relative to older 
workers {Grasso. 1977, Welch, forth- 
coming. Smith & Welch. 1978).^^ 

To test the second hypothesis, years 
of overeducation ' were calculated 
for each. rjBspoQdent using equation 



'^Whether or not the rates of return to 
schooling fell in this same period is. of 
course. anothermatter Returns toschooling 
depend upon other benefits from schooling 
as well as costs The results presented here 
do not allow us to determine changes in the 
return stoschoolmg between 1969 and 1975 
Even if the stability of relativeearnmgs failed 
to reduce the private returns to schooling, 
thesoc lal return may have fallen nonetheless 
(Thurow. 1975). Thus, relative earnings, 
tfy themselves, only provide a partial under- 
standing of both the economic position of 
workers in the labor m^ket ahd the in- 
centives for individuals and society to invest 
in schooling 

I am continuing to investigate changes 
in relative earnings since 1975*in order to 
docunnent any developing trends 

''These observed variations also appear 
to depend on whether one looks at relative 
annual earnings or relative weekly earn- 
ings Welch (forthcoming) observed some 
decline in relative weekly earnings between 
1969 and 1975 among inexperienced 
workers using CPS data, but some increase 
in annual earnings during this same period 
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2 The resulting variable was then 
regressed on education and other 
variables according to equation 3. 
The estimated coefficients appear 
in Table 2 and estimated years of 
overeducation by schooling level 
are illustrated m Figure 1. 

The results indicate that overedu- 
cation IS widespread throughbut the 
labor market, affecting high school 
^as well as college graduates 
Furthermore, the evidence suggests 
that the economic position of college 
graduates worsened both absolutely 
and relative to high school graduates 
between 1970 and 1976. White males 
with four years of coll,ege were more 
overeducated for their jobs m 1976 
than in 1970. tThe position of black 
males also deteriorated, they were 
less overeducated for their jobs m 
1970 than high school completers, 
but by 1976 this relative advantage 
had disappeared The position of 
workers with other educational cre- 
dentials changed little in this period, 
except for black males with one-three 
years of college* who improved their 
position somewhat 

These results are comparable with 
those reported m other studies Lucas 
(1972) estimated years of overeduca- 
tion by years of schooling completed 
using 1966 data and observed a rela- 
tionship simila[ to one illustrated m 
Figure 1 Grasso and Myers (1977) 
also constructed several indices of 
economic well-being for new en- 
tcants ■ in two periods 1966-1968 
and 1969-1971 One was based on 
a prestige rating of respondents jobs 
and the other on GEO level In both 
cases the more recent college grad- 
uates experienced a decline in eco- 



It appears that workers in the lowest 
education groups (less than 8 years of 
schQolmg) actually are "undereducated 
for their jobs — that is; they hold jobs which 
require more educational skilfe than 'they 
appear to possess This finaing raises the 
question of how suph workers can perform 
satisfactorily m their jobs if the specified 
relationship between GEO levels and edu- 
cation IS accurate See the discussion by 
Scoville (1966) 




TABLE 2 

Estimated Years of Overeducation for Inexperienced Males by Race 





1970 and 1976 








Whites 






Blacks 




1970 


1976 


1970 


1976 


Schooling 








-3 86" 


0-8 Yrs 


-3 78" 


■3.67" 


-4.74" 


5T" 1 1 T lb. 


-1.21" 


1.21" 


-1.60" 


-1.38" 


12, Yrs. 


•~" 








13-1 5 Yrs 


.86" 


.81" 


1.22" 


03 


ID T lo. 


-.05 


.60" 


-.85+ 


- 32 


17 + Yrs. 


1 37" 


1.23" 


37 


-.32 


cxp6ri6nc6 Trs. 


-.16" 


-.13" 


.08 


-.19" 


Single 










rviari it3\j 


f — 20^* 


-.23" 


- 17 


.04 


Previously Married 


29 




41 


.17 


Private Sector 










Public Sector 


- 71" 


-.55" 


- 38 + 


- 17 


Self- Em ployed 


1 31" 


-.94" 


1 34 


-2 16* 


Constant 


2 42 


2.64 


3 07 


3.68 




17 


.15 


30 


.13 


# of Observations 


7743 


6355 


715 


525 


Mean "Overed " in Yrs. 


1 67 t 


2 01 


1 87 


2 43 



+ Significant at 10 level 
* Significant at 05 level 

" Significant at .01 level ' ' 

FIGURE 1 

Estimated Years of Overeducation by Schooling Level for Inexperienced 
Males by Race: 1970 and 1976 



4 - 



5 2 

41 

u 

3 
"O 



2 0 

o 

e 

> 



Black Males — 1976 
Black MalQS — 1970 




-I I I L. 



_L 



10 12 
Yftart of Schooling 



14 



16 



Note estimates are computed for a ' typical" worker one with 
a mean years of experience, single, and employed in the private 
sector 
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homic posiliorT between the two 
periods Recall that they also found 
that recent college graduates did not 
suffer a .decline between these two 
periods when econonnic position 
was measured by relative earnings 

In summary^ when economic^ posi- 
tion IS measured I5y years of overedu- 
cation, college graduates apf^ear to 
have suffered a decline m economic 
position between 1970 and 1976 

CONeiUSIONS 

Jhe results presented in this paper 
should be interpreted with caution 
In particular, future attention should 
focus on constructing a more accurate 
• index of t)vereducation, accounting 
for^chamges in the skill requirements 
of jobs and the educational creden- 
tials of workers (Rumberger, 1978) 
Nonetheless, the results presented 
here shed some light on the labor 
market situation for new entrants 
into the labor force Based on relative 
earnings it does not appear that 
recent college graduates, as a "group, 
are any worse-off than their counter- 
parts SIX years earlier. Based on 
years of overeducati.on. however, 
it appears that college graduates are 
wocse-off — that is. they were more 
overeducated for their jobs in 1976 
p/an m 1970 

These two economic indices :pro^^ 
vide conflicting indications of the 
position of workers in the contem- 
porary labor market because they 
focu^ on different aspects of the 
relationship iSetwSen education 'and 
work Pjfferenoes in earnings be- 
tween workers with various edupa- 
•lionaV credentials are used to dom- 
pute social and private incentives to 
investment m education Overe^u- 
catiop attempts to account dlr^ctly 
for the utilization .of educat^^nclt 
skills in the labor market j^ckaus", 
1964) It mays^also convey pnore use- 
lul^information on the effects of edu- 
cation' m th^'firm For example, 
^viderlce suggests that overeduca- 
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tion may have potentially disruptive' 
and adverse consequences in the 
workplace (Rumberger, 1978, Chapter 
5). 

The results reported here contradict 
the view put forth by Freeman that 
the relative earnings of college 
graduates have declined in recent 
years. On the other handj^'they sup- 
port the view offered by Thurow that 
the absolute position of college 
graduates may actually be declmin'g. 
even in the face of constant relative 
earnings In other words, the social 
rate of returri^ay be declining as 
more-educated 'workers displace 
less-educated ones m the same job, 
while private rates of return remain 
constant or even increase. 

The preceding discussion suggests 
that any single, one-dimensional 
measure of economic well-being 
provides an unsatisfactory indication 
of the benefits (either positive or 
negative) of education in the labor 
market It is a conclusionthat warrants 
further discussion. 
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The Career information System: 
A Decade of Developmental Research 



BRUCE McKlNLAY AND . 
MICHAEL R. McKEEVER ^ 
University of Oregon 
Like most innovaljons, computerized 
occupational and educational infor- 
nnation delivery systems have passed 
through stages of'>^itial design, de- 
velopment, implementation, replica- 
tion, and recently proliferation. In 
1970, prototype systems could bB 
found in field test situations with 
limited audiences Today several are 
fully operational, serving students 
and counseling clients in school 
districts, social agencies, and col- 
leges and universities in all regions 
of the country. The design, devel- 
opment, and testing of the Career 
Information System (CIS) and its 
operational implementation within 
stale-based research and develop^ 
nnent ce^jpters is of interest because of 
Its research program and because it 
has been the model most replicated 
by slates across the country 

Research within* such a develop- 
mental environment has great ad- 
vantages, but It IS also conducted 
under certain constraints. The ad- 
vantages are that experimentation 
IS a prominent feature of the develop- 
mental environment and that the 
research has immediate impact In 
such situations, qualitative and des- 
criptive observations can often be 
useful as statistical outcome data 
in answering questions about program 
design. Thus, formative evaluation 
techniques which explain as well as 
judge product performance (Gardner. 
1978) have proven useful Use of a 
variety of research techniques helps 
address the often disparate needs of 
the evaluator, the developer, the user, 
and various implementers This is 



especially true for a consumer ori- 
ented informahon system System 
research must take place in natural 
environments where people use the 
system at will. Developing a research 
program in which observations are 
sufficiently controlled to yield valid 
results while not so obtrusive as to 
substantially influence the results is 
a delicate task. 

The state of the art in occupational 
and educational information delivery 
systems has been greatly refined over 
the last fen years. Knowledge about 
the informational needs of guidance 
counselors, students, and adults and 
the ability to computerize delivery 
systems to meet those needs has in- 
creased substantially This paper will 
present the highlights of the research 
and development effort conducted 
during developnrient and implemen- 
tation of CIS The system serves 
about one-tenth of the people in 
Oregon and has been replicated in 
nine states. 

Operationally. CIS is comprised of 
an information analysis component, 
computer and manual information 
delivery, and counselor training pro- 
grams. The delivery system consists 
of QUEST (a structured acces3 de- 
vice), four primary information files, 
and four secondary information files. 

STRUCTURED ACCESSING DEVICE 

QUEST IS a 21-item questionnaire 
about work preferences to help people 
initiate their information search. 
People express a preference on topics 
such as the nature of the work, level 
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of abilities, degree of physic^ai activity, 
amount of education or training, and 
wage and salary level The system 
identified occupational fields where 
'these interests and abilities are com- * 
monly used. It enables the person to 
estimate the effect of various choices 
by generating alternative occupational 
lists for which the person may wish 
to seek information 

PRIMARY FILES 

The Occupational Description File 
provides up to two pages of up-to-date 
and localized information on the func- 
tion, duties, hiring requirements, major 
employers, work setting, current 
employment, wage, and employment 
outlook for all of the major occupa- ' 
lional fields found in the state and 
region 

The Preparation File forms a link 
between the occupations and educa- 
tional files by providing information 
on specific skill requirements and 
alternative ways to prepare for any of 
the occupations This file also con- 
tains information on high school 
subjects related to occupations in 
each of the career f^ilies or occupa- 
tional clusters and a list of related 
occupations 

The Program of Study and Training 
File describes educational programs 
{including apprenticeship training) in 
130 categories by their content, 
length, and typical coursework The 
file also prints regional lists of the 
institutions offering a particular pro- 
gram, the titles and descriptions of 
their prog^rams. the type of diploma 
they offer, and application proce- 
dures 

The School File provides institutional 
information about all public and pri- 
vate colleges, universities, and train- 
ing schools in the state Over 60 toprcs 
covering the characteristics, cur- 
riculum, costs, and services of schools 
are covered Secondary resource 
files include Bibliography and Book 
File, Visit File. Clubs File, and Finan- 
^ cial Aid File 



A career information system affects 
several audiences, each of which 
rightfully has its own notions of the ^ 
most compelling criterion for judg- 
ing such a system A psychologist 
will want to know how such a service 
enhances individual choice m a career 
development process, a labor econo- 
mist will be interested in the accuracy 
of the system's data, the adminis- 
trator Will ask about its cost effective- 
ness, and the client may judge the 
system on its ease of use and personal 
relevance of the information 

The research and evaluatio'n effort 
that accompanied and influenced 
the development of the CIS delivery 
system is herein described A fully 
operational CIS did not result from a 
single project, but rather a 10-year 
development program in which a re- 
search and evaluation program was 
an integral part This research and 
evaluation effort has concentrated on 
seven issues 

MAJOR ISSUES FOR DELIVERY SYSTEM 
RESEARCH 

1. How does an occupational an^ 
educational information delivery 
system interface with the traditional 
guidance function? 

The counselor, whether in an educa- 
tional institution,' vocational rehabili- 
tation center, employment office or 
prison has ^traditionally been the 
primary formal information source for 
people in the various stages of career 
decision making Before designing a 
mechanized system of career informa- 
tion. It was necessary to formulate 
working hypotheses on 

— roffe of occupational and educa- 
tional information in the overall 
guidance process 

— nature of .unmet information 
needs 

— role of the guidance counselor 
when assisted by an occupational 
and educational informatiori de- 

^ livery system 
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2. How effective is the mechanized 
delivery of occupational and educa*^ 
tionai information compared with the 
delivery of such information through 
guidance counselors? 

Once a role for an information sys- 
tem in the guidance^process has been 
established, the comparative effec- 
tiveness of the innovative versus the 
traditional delivery means was ex- 
amined Primary areas of comparison 
included. 

— storage, retrieval, and update 
capabilities 

~ amount of time required 

— cost to the institution 

3. ^an a computerized information 
dellMry system be client operated? 

The utility of a mechanized informa- 
tion system is significantly restricted 
if most people require assistance from 
a professional to operate the system 
Two inviolable standards in this 
respect are 

— operation of the system must be 
Simple including system instruc- 
tions, computer commands, and 
methods to correct improper en- 
tries 

— information must be readable 
and understandable 

4. Istbe structure, order, andjormat 
of the ac^ss procedure (in this case 
QUEST) and Information files in* 
ternatly logical and flexible so as to 
optlndlze successful individual Infor- 
mation searches? 

At issue IS whether a person can 
quickly answer specific information 
questions as well as learn of and 
retrieve additional information dis- 
covered' to be useful during system 
use Two links, those from QUEST 
to the file and those between the 
occupational and educational informa- 
tion files, are particularly important 
Among the key indicators of an 
effective file structure are 

— traffic from the structured access 
device (QUEST and QUEST List) 
into the occupational description 
files 



— pattern of multiple file accessing 
according to the cross reference 
system used withtn each file 

— minonly of users access a file or 
files in direct fashion which may 
seem random 

5. Does an occupational and edu* 
cational information system make an 
Impact on those who use it? 

Impact on peoples knowledge, at- 
titudes, and behavior can occur m a 
number of ways Some of the major 
issues include. 

— result of increased occupational 
knowledge of occupations and 
education 

— awareness affect of viable op- 
tions 

— user career plans affect 

— actual or educational history af- 
fect 

6. Is an occupational and educa* 
tionai information delivery system 
useful to a wide variety of people? 

Career planning is an important 
complement to both vocational and 
liberal education, as well as m jOb 
search and career change Nearly 
everyone makes career decisions 
throughout their lives, though the 
decision styles and options differ 
The most effective information service 
would meet the needs of pedpleduring 
several phases of the career planning 
and dectston-maktng process as well 
as those' with varying abilities Among 
the special groups where use of a 
mechanized information service 
should be examined are 

— the disadvantaged 

— those undergoing career changes 

— labor force re-entrants 

— first-time career decision-makers 

— career explorers 

7. Is a system of career Information 
attractive to people? 

No system will do any good if it is 
not used. Key tests of general system 
appeal include. 

— client reported affective respon- 
ses to the system 

— client repeat usage rate 
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— frequency of use within an insti- 
^ tutfon 

— number of institutions using^he 
system 

RESEARCH TECHNIQUES 

CIS has used a variety of evaluation 
techniques to determine system ef- 
fectiveness in each of these seven 
areas A description of the research 
tecfiniques and their applicability to 
select research topic areas follows 

Literature Reviews 

Review of available literature was 
important during the early design 
•phases of the Career Information 
System In particular, career develop- 
ment literature helped define the role 
of information in the career choice 
process Lack of empirical data on this 
subject IS probably the single biggest 
gap in occupational choice research, 
so the words of top career develop- 
ment theorists were used to help 
elucidate, often inferentially . the 
potential role of career information in 
the guidance process Literature re- 
views were also helpful in establishing 
the validity of client self-reports of 
abilities and preferences on the QUEST 
instrument 

• ' Review of Current Counselor Training 
Programs 

In the early 1970s little had been writ- 
ten about how guidance counselor 
training programs equipped studejlts 
to gather, interpret, and dissemin»^ 
occupational and educational info^ 
mation CIS undertook a study of 
Northwest pre-service training pro- 
grams and local in-service programs 
for guidance counselors College 
catalogues and course lists were sur- 
veyed for every college and university 
in Oregon and Washington and de- 
partment heads at several schools 
^0 were interviewed to pinpoint the na- 
ture, scope, and status (required or 
voluntary) of all courses dealing with 
career information In addition, 
guidance counselors at focal agen- 
cies were interviewed to identify the 



nature and frequency of in-service 
programs dealing with this subject. 
These data were essential in deter- 
mining the labor market information 
needs of guidance counselors 

Expert Consultant Panels 

Product development m a new, inter- 
disciplinary field would be difficult 
indeed without the insight and advice 
of experts and practitioners. CIS 
fused parts of two previously distinct 
disciplines of labor market analysis 
and career'development psychology, 
hence professionals from both fields 
were used heavily, in particular to 
make recommendations on the con- 
struction of QUEST This technique is 
generally accepted today in higher 
education research (Legge. 1978) 

Computer System Use Records 

This data gathering technique is pos- 
sibly unique to computerized delivery 
systems. Using a special statistical 
package program, the computer can 
record, reformat, and list cumulative 
data on system use by clients. Data 
on frequency of system use, average 
use time, and frequency of individual 
file use are continuously com^piled 
for each CIS site (the program does not 
keep individual client record^This 
data source provides CIS researchers 
and administrators with a good over- 
all measure of system use Usage rates 
at different site types are compared 
and used to identify successful site 
implementation strategies as well as 
sites in need of assistance Similarly, 
data on response distributions pro- 
vide a good basic monitor for that 
instrument Usage rates for important 
computer pommands and most fre- 
quently accessed entnes within each 
file are also tabulated. ^ 

Computer Printouts 

Data on topics too specific to warrant 
continuing compilation and storage 
by the computer can be obtained 
periodically by examining individual' 
computer printouts. CIS staff have 
used this technique to count frequency 
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of computer command errors and to 
determine the order in which files 
are accessed. These data were es- 
sential to determine whether the file 
structure was encouraging logical 
cross-referencing activity between 
files as intended. 

Interviews 

Interviews have been used to gather 
statistically interpretable data as well 
as insightful anecdotal comments 
Telephone interviews with control 
and experimental groups (counselor 
delivered information versus CIS 
delivered information) were con- 
ducted at a community college to 
determine comparative motivation, 
behavior, satisfaction, impact, and 
time spent collecting information of 
both groups of students After initial 
system pilot tests in six Eugene area 
social agencies and schools, guidance 
counselors were interviewed to de- 
termine specifically how they utilized 
CIS m the counseling process and how 
satisfied they were with its perform- 
ance Several counselors at three 
Portland area Employment Service 
offices were interviewed after pilot 
use there 

An excellent check for Quest item 
clarity has proven to be interviews 
with different groups of students 
Acadecnically successful, and disad- 
vantaged groups bring different 
perspectives and interpretations to 
word meaning, inclusion -of both 
groups in the QUEST editing process 
has produced good results. Inter- 
views with parents of stiTdent CIS 
users have also been conducted to 
determine how frequently CIS use 
IS discussed in the home 

PencihPaper Instruments 

Pencil paper questionnaires and tests 
have provided the broadest range of 
evaluation data on CIS use and effec- 
tiveness Specific design oriented 
examples are listed below 
Control-Expenmental'Expenmental 
Group Po^t-Test. A major study at 
three large city Employment Service 



offices measured the comparative 
satisfactoriness, ease of use, read- 
ability, and impact of CIS on nondis- 
advantaged versus disadvantaged 
clients and manual needle-sort versus 
^computer terminal users. 
Control-Experimental Group Post- 
Test At the end of a school year of 
CIS use at a high school, users and 
non-users were administered ques- 
tionnaires to determine what moti- 
vated some to use CIS and why others 
stayed away. Those using CIS also 
rated the system on ease of use, 
completeness and relevance of in- 
formation, general satisfaction, and 
impact. 

Experimental Group Pre-Post Test 
This experimental design is necessary 
to measure short-term impact of CIS 
use When the educational files were 
added to CIS, pre- and post-use instru- 
ments were used to measure changes 
in reported choices of occupations, 
programs of study and training, 
schools, and the certainty of users 
choices Impact data were collected 
in schools, correctional institutions, 
and shopping centers Shopping 
centers were chosen in order to reach 
an adult population including women 
reentering the labor force or con- 
sidering additional education, per- 
sons unfiappy in their present jobs., 
*and unemployed persons. Results 
were controlled for age. sex. educa- 
tional standing, and family income 
Experimental Group Post-Test Post 
use questionnaires have been ad- 
ministered to junior high, high school, 
community college and four-year 
university students, social agency 
counselees including Vocational 
Rehabilitation and Employment Ser- 
vice clients, adults at shopping centers, 
inmates at correctional institutions, 
and disadvantaged on topics related 
to the process of CIS A recent applica- 
tion of this technique is an on-line 
evaluation question which the user 
answers after he or she has com- 
pleted the CIS computer program 
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Major Findings 

The major findings with regard to CIS 
design and operation are presented 
here. The findings evolve from a. re- 
search and evaluation program that 
employed a variety of sources and 
methods m documenting, shaping, 
and appraising the (developmental 
process 

1* How does an occupational and 
educational information delivery 
system interface with the traditional 
guidance functions? 

Many writers have attempted to 
explain career development. Despite 
sociological and accidental influences, 
the common conclusions of the fore- 
m ost authorities is that career develop- 
ment IS essentially a series of indi- 
vidual choices which occur over time 
(Ginzberg. 1972. Super, 1957. Tyler. 
1969) The key factors affecting the 
deciSion-making process include (1) 
the individual s decision-making skills. 
(2) knowledge of self, and (3) knowl- 
edge of the world of work. Tyler says 
that to make sound career choices 
the individual needs relevant infor- 
nnation about the field of work (Tyler, 
1969, p 110) Super considers pos- 
session of information concerning 
the preferred occupations a very, 
essential part of an individual's vb- 
cationaLj[;Jevelopmejnt (Osipow, 1968. 
pp 124-25) Nobody claims that these 
decisions are based solely on laboK 
market data, but there is consensus 
that occupational information is one 
of the ingredients in career decisions 
This literature yielded a conceptual 
framework within which an informa- 
tion system might function, but it was 
less articulate about the form and 
content that information should take' 
to be most useful in guidance These 
matters had to be inferred from the 
literature and from a review of tradi- 
tions in the career information field 

Guidance counselors were found to 
be better prepared to deal with other 
ingredients m career decisions than 
the information component A survey 
of four-year institutions in Washington 



and Oregon found that while nearty 
all offered at least one course relating 
to vocational information, those 
courses did not prepare counselors 
to judge the access procedures, the 
delivery media, or the format of the 
occu^pational information (Selton, 
1970). What pre-service training pro- 
grams lacked, m-service programs 
did not remedy. In a survey of in- 
service training programs in several 
agencies, the researcher reported 
that it seems safe to conclude that 
counselors do not receive any formal 
m-service training in the use of labor 
market information" (Shadbolt. 1970, 
p.1) 

Not surprisingly, a review of the 
labor r^arket information publica- 
tions found in local schools and agen- 
cies showed that counselors there 
made little use of existing occupa- 
tional information sources CIS was 
found to be a valuable resource in 
the counseling program Pilot tests 
found that counselors could let clients 
retrieve information from the com- 
puter terminal alone, allowing the 
counselor to concentrate on inter- 
pretations and personal planning 
(Weick. 1972) In a pilot test at a 
comprehensive high school, most 
students were able to operate CIS 
independently, going to their guidance 
counselor to discuss their experience 
afterward (McKinlay & Adams, 1971) 

2. How effective is the mechanized 
delivery of occupational and educa- 
tional information compared with the 
delivery of such information through 
guidance counselors? 

As a component of a guidance pro- 
gram. CIS was proven to have many 
advantages including supplementing 
the counselor. Counselors are trained 
to help people interpret their feelings, 
not to compile information about a 
complex and dynamic labor market 
It almost goes without saying that 
the combination of three or four pro- 
fessional information analysts com- 
bined with the superior storage, /re- 
trieval and updating capabilities of 
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the computer would far surpass the 
ability of any single staff person un- 
trained in labor market data analysis 
and principally committed to direct 
service to' clients One field test 
showed a substantial time savings 
to the counselor With access to CIS. 
average information search time 
dropped from 1 69 hours to 85 hours 
per person (Ross. 1971) 

3. Can a computerized Information 
delivery system be client operated? 

Not much occupational data has 
been applied to guidance before, and 
putting computers into the hands of 
average people was a new application 
of the medium that raised many prac- 
tical questions Thus, numerous user 
surveys have been conducted, and the 
Career Information System has con- 
sistently been found easy to under- 
stand In an early test 95 and 94 
percent of the users rated the occupa- 
tional descriptions and QUEST easy 
to understand (McKinlay & Adams. 
1971) Readability formulas rated the 
original QUEST between seventh and 
tenth grade levels and the occupa- 
tional descriptions somewhat more 
difficult, although readability formulas 
have limited validity as a measure of 
the consumability of specific data 
such as occupational information 
(Readability and Validity) Tests with 
disadvantaged clients found that 94 
percent rated QUEST easy to read 
(Weick. 1972) and 93 percent gave 
the occupational descriptions a simi- 
lar rating (Weick. 1972) Reading is 
required, of course, and the system 
IS not directly usable by persons so 
severely disadvantaged that they lack 
basic language skills 

CIS has also' been proven mechani- 
cally Simple to operate After expand- 
ing the file structure to include educa- 
tional and training information, 100 
percent of the users in one field test 
rated the Description. Preparation, 
and Program files easy to u'se while 
over 90 percent gave the tabular 
School file a similar rating (McKeever, 
1975) Examination of user printouts 
for operational errors found thaf 



over half (50.2 percent) made no errors 
at alt while using the system and nearly 
9 out of 10 made three errors or 
fewer (McKeever, 1^75). The system 
IS designed so that errors are easy 
to correct and do not disrupt the 
program Corrections apparently are 
not particularly bothersome to users 
as their perceptions of both system'^ 
adeqjjacy and relevance were not 
correlated with the number of operat- 
ing errors made (McKeever. 1975) 
Computer system use records and 
user evaluations have been instru- 
mental in stimulating refinements 
in computer routines 

4. Does the structure, order, and 
format of the acc,ess procedure and 
Information files 'optimize individual 
information searches? 

QUEST, designed to help people 
begin their information search, met 
this primary goal quite effectively 
In a recent examination of usage pal- 
terns for a revised QUEST, over 80 
percent of CIS users at junior high 
schools, high schools, community 
colleges, and correctional institu- 
tions" used the occupational titles 
from their QUEST list to access an 
Occupational Descript-on Earlier 
research had already shown that 
users move directly and logically 
from QUEST to either the Program 
or Preparation files (McKeever, 1975). 

The other important conceptual link 
for users to make is between the oc- 
cupation and educational information. 
Such a system must reflect the diverse 
and flexible relationships that exist 
between education and work, it.mMSt 
not simply make mechanical con- 
versions that oversimplify reality. 
Examination of users printouts and 
computer use records shows that 
over 10 out of 20 users who accessed 
the Description and Preparation 
files made links between them. Nearly 
four out of every five users accessing 
both the Occupational Preparation 
and the Training Program files made 
the conceptual link between educa- 
tion and work described m the two 
files (McKeever. 1975) 
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5. Does ah occupational and edu- 
cational information system make 
an impact on those who use it? 

The first and most basic test of 
an information system is whether 
peoples knowledge increases from 
usingnt. An objective test for local 
occupational knowledge among 
high schOQl students was used to 
determine whether CIS users knew 
more about the occupations they 
were considering. The CIS user group 
scored 32''percent better than the con- 
trol group, a chi square significance 
at the 001 level For national occupa- 
tional knowledge, the mean for users 
was again better than for non-users 
(Significance at 05) (McKinlay & 
^ Adams, 1971) Complementary evi- 
dence was found at the junior high 
school level with system users scor- 
ing higher on an objective test, re- 
^porting higher vocational aspirations, 
and listing nearly twice as many oc- 
cupational titles as non-users (Adams 
& Fowler. 1971)^ 

Impact on user can also be judged 
in* ternrvs of people's career plans In 
addition to increasing actual knowl- 
edge, useful information should affect 
people's schooling or work plans 
In a pre- and post-test analysis from 
a sample of adults, high school stu- 
dents, community college students, 
and inmates, nearly three out of 
ten (29 2 percent) actually changed 
their first choice occupation after 
using the system, over a third (35 8 
percent) changed their first choice 
program of study and training, and 
1 0 5 percent changed their first choice 
school (McKeever. 1975) 

A final measure of system impact 
on users' career plans is whether ft 
helps people identify new career 
options One test showed nearly half 
of CIS users reporting that they had 
received several job ideas (49 7 per- 
cent) (McKeever. 19,75). while a recent 
study of a revised QUEST found over 
eight out of ten users reporting their 
QUEST list had included new occu- 
pations they would seriously con- 
sider for future work In a test with 



disadvantaged clients, 76 percent 
reported that their QUEST list had 
given them new job titles to consider 
for future work (Weick, 1972), a 
particularly important effect for a 
group whose options and knowledge 
are so circumscribed 

A field test at a high school pro- 
duced an unanticipated result — 
students were discussing their ex- 
perience using CIS with their parents 
In a telephone survey of a small sample 
of users' parents, 64 percent reported 
having discussed their children's use 
of CIS. Of these parents, a little. more, 
than»30 percent had seen their chil- 
dren's QUEST list, occupational des* 
cription, printout, or questionnaire 
Discussions between parents and stu- 
dents lasted an average- of 47 minutes 
and frequently occurred more than 
once (Wish, 1975) This piece of data 
IS intrigumg because significant 
others, particularly parents, are in- 
fluences in the occupational choices 
of young people 

6. Is the delivery system tseful to 
a wide variety of people? 

Career developmen-t theory im- 
plies that labor market ^formation 
IS helpful at all stages. This is not- 
prima facie cause to conclude that 
all information delivery systems will 
be equallvT beneficial to aM groups, 
however To determine the range of 
CIS effectiveness, system researchers 
have evaluated it with adults, the dis- 
advantaged, inmates, rural, sub-urban 
and inner city junior fiigh. senior high 
school' and community college stu- 
dents. Evaluation results have also 
been studied on the basis of age, sex. 
family income, and educational back- 
ground. This section will summarize 
research findings on three groups, 
adults, disadvantaged, and inmates. 

Inmates found the system easy to 
operate (only six percent made more 
than three errors). A majority (65.6 
percent) rated QUEST questionnaire 
relevant to their career planning 
process and over seven out of 10 
(7 1 .7 percent) received nfew job 
ideas for serious consideration from 
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QLTEST (McKinlay. 1975) Over 70 
percent oi the sample rated each of 
the four major information files, 
relevant to the'ir decision-makmg 
process, and CIS information caused, 
several inmates- to change their f/fst 
choice career field (19 percent) 
educational program (26 percer 
Larger percerrtages changed the ceA 
tainty of their first choice career field 
(22 percent), edtjtational program 
(36 percent), and school (13 percent),. 
General satisfaction with CIS among 
inmate? was high with 90 percent 
reporting they would "^^robably or 
definitely use the system again, nearly 
all (98 percent) saying they would 
probably or definitely recommend 
the system to a friend, and all subjects 
claiming the CIS information would 
be helpful in planning their release 

'program (McKinlay. 1975) 

A test of disadvantaged and non- 
disadvantaged clients in three Em- 
ployment Service offices, including 
special offices for ghetto residents 
and disadvantaged youths, found that 
disadvantaged clients rated the occu- 
pational descriptions accurate and 

»up-to-date (80 percent), complete 
(fli percent), easy to read (93 percent), 
fun to uhe (86 percent), and relevant 
to their own likes, dislikes, values, 
and skills (96 percent) (Weick. T972) 

7. is the system attractive? 

Both user surveys and system use 
records show that people like to use 
CIS and feel they benefit from tloing 
so In an early XIS field test in which 
the system received completely volun- 
tary use. 550 out of a^^opulation of 
1,040 high school students used the 
system in a five-month period Most 
used CIS more than once and the 
average student used the system 2 3 
times (McKmlay & Adams. 1971) Of 
those who used the system, most did 
so because they were ^ personally 
interested in looking for occupational 
information" ^41 percent) or were 
curious about the computer" (32 
percent) (McKmlay & Adams, 1971) 
Nearly all (99 percent) said CIS was 
"fun to use." 84 percent were satisfied 



with the information they received, 
87 percertt had found the information 
they weri^looking for, 86 percent 
said they^vy^anted to use CIS again, 
and 77 percent had already recom- 
mended the system to a friend 
(McKinlay & Adams/l971)/ln an earlrer • 

^study at the same school, nearly 
ime out of ten (88 percent) users 

Vepommended that CIS be kept at 
their school (McKinlay & RosSt-J970) 

CONCLUSIONS AND OBSERVATIONS 

A developmental program is a fertile 
environment in which to do research 
because there are numerous design 
and impact questions to be answered 
The research need is especially di- 
verse in a novel, interdisciplinary 
undertaking like the development 
of the Career Information System, 
which combines labor market re- 
search with computer technology m 
guidance programs Consequently, 
the CIS research program has used 
a variety of data sources and formative 
research methods to describe, in- 
fluence and assess the developmental 
program The diversity of the research 
and the,ongoing nature of the research 
effort have necessarily limited this 
paper's description of any single^^ 
survey or analysis 

Persons familiar with systems for 
career information will notice other 
limitations^ of this paper First of all, 
i\ describes only the evaluation of 
the delivery components of the sys- 
tem, omitting the other major opera-, 
tional components of information 
analysis and counselor training 
Likewise, it has described only the 
research on the Career Information 
System which was part of the original 
developmental program', thus omit- 
ting two other bodies pf research 
Developmentaf research on other 
systems for the delivery of career 
informalion has not been discussed 

Implementation o.f the Career In- 
formation System in other locatioris 
IS generating a body of project re- 
ports, evaluation studies, and research / 
by irViplementers and scholars' 
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throughout the country This research 
has also Been omitted because of 
this paper's emphasis on the initial , 
developmental research A consider- 
able degree of comparability with the 
developmental research has been 
maintained m th^se implementation 
studies They verify^nany of the 
general observations described here, 
but they include some distm.ctive 
local difficulties as well 

As systems-tfor career information 
become more widely used, there will 
be a need forbroader based and better 
endowed research Methodological 
experimentation can produce better 
tools for evaluation Those currently 
available are often inappropriate and 
those originated for the purpose are 
frequently non-standardized Tech- 
niques leading to intermediate range 
follow-up studies are needed *to 
ascertain the lasting effects of the 
availability of easily accessible in- 
formation through these system^ « ^ 
Similarly, rigorous comparisons of 
the several systems would contribute 
to an understanding of wh'at is better, 
not just different between one'system 
and. another While findings about 
the attractiveness of systems is com- 
' mon in the evaluation^ that have been 
done, the systems are not all inter- 
changeable Diffecent designs do have 
different effects on different audiences 
and on operating costs as well 

A third research need is for more 
studies of system use with special 
labor force groups and nontraditional 
students Though the research des- 
cribed here has indicated that CIS 
serves surprisingly diverse audiences. 
It also reveajs that their uses differ 
Those differences need to be under- 
stood and protected as system use 
-"is integrated into institutional ser 
,vices 
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Synthesis 

Employment and Trainmg research offers tremendous potential for 
^well-trained, competent vocational education researchers. There are 

- several factors which support, this conclusion. First, the U.S. Depart- 
menf of Labor* is interested m many of the sanr^e areas of research, as 
vocational" educators. As the result of titese compatible priorities, 
research funds are continual^ made available to vocational education 
to sponsor well designed* proposals that wiH build upon the information 
base currently available to the Department of Labor* Secondly, many 

%0f the current DOL sponsored developmental occupational training 
programs are inno^vative. Such innovative progranis can provide an 
opportunity for vocational education researchers to study problems 
in a context applicaOle to traditional programs of vocational ed ucation 
Thirdly, the developmental and socially related goals of Ei&T sponsored 
research will ^energize. more cooperative research acti.vities relating to 
special needs populations. Such activities wilLprovide,for the improve- 
ment, both qualitatively and quantitatively, of services offered by 
vocational education. Finalfy. the desire of the U.S. Department of Labor 
to focus some of its resources on sophisticated research projects of 
national scope wilt provide, unique opport unities to hiany vocational, 
education researchers. There are* comparatively fe^v research oppor-^ 
tunities, to stud/" populations and samples of literally thousands of 
individuals. Lil^ewise, there qre i;elatively lew projects that are con- 
cerned with the study of both the training ^nd the development (social, 
cultural, economic.^ and educatiooal) of subjects. These unique foci 
offer the voqatronal education ("eseq/cher an opportunity to greatly 
expand his or" her technical abilities and interests. 

Upon reviewing the cuYrerit arid recent E&T related research, it 
became apparent that a high percentage of the studies could be clas- 
sified by the following functional groups' 

- 1. Follow-Up Studies. ^ ' \ • 
2. Evaluation Studies. 

' 3. Policy Studies, 

4. Experimental Studies, 

5. Longitudinal Studies, - 

6 Cluster Studies (multiple projects with a common goal(s)) 
7. Reflective Synthesis (historical)* ' . • 

The five articles in this^^ction each represent one or a combination 
of tjie above noted types of studies. Four of the representative studies 
are national in scope, Thfe fifth. l?y Dr, Max Wortman. et al., is an on- 
going project funded by the Governox'rf Employment and Training 
Counckl oT Virginia, This project was chosen to illustrate the types of 
E&T'^r^^ated studies that are often needed by state CETA agencies 
The project reports resulted from* sponsored activities from one or more 
of the following types of E&T fundir)C! sources: ' 

1. Governor'^ Employment and Traimng Councfl (CETA-State) 

2. Prime Sponsor (CETA-State) 




3 U.S. Department of Labor (Office of Research. Employment and 
" Training Administration) 

4. Balance-of-State (CETA-State) 

5. U.S. Department of Labor (CETA-Regional Office) 

6. Contractors and sub-contractors of CETA sponsored progra/ns 
(CETA-State/National) - ' 

The projects mirror universal research philosophy of E&T agencies 
Sponsored E&T research and development usually possesses three 
characteristics. First, the studies usually have immediate application 
to the programs conducted by ETA. Second, the research designs 
generally address the problem in a realistic and efficient manner. 
Finally, E&T research and development is primarily focused upon 
problems and concerns that are identified by local program operators. 
Thus, functional research is the key to successful E&T research efforts 
To illustrate these points the following brief reviews of the represen- 
tative studies are presented. 

PARNES AND SPROAT STUDY 

The National Longitudinal Surveys represent a series of projects that 
were combined arfd funded to provide a data base for the design'^'of 
public employment and training policy. The project was initiated in 
1965 at the Cente)- of Human Resource Research, The Ohio State Uni- 
versity, under contract to the U.S Department of Labor The project 
enables NLS researchers to collect and analyze data over time for men 
(age 45-49). women (age 30-44), young men (age 14-24). young women 
(age ,14-24). and youth, (age 14-21). Data reflect the successes and 
failures of growing up. getting an education, obtaining employment, 
unemployment, etc. Five nationally representative samples were chosen 
to represent those population segments that are consi-dered to be 
most hkeiy to experience difficulties in the labor market. The "men 
and women respondents are interviewed every other year while the 
other three samples are interviewed annually. Each year the data 
are analyzed by an interdisciplinary team from The Center for Human 
Resource Research. Computer tapes are developed for dissemination 
to the research community. 

The project is unique in that it collects data not otherwise avail- 
able It provides a ^quantification of a variety of labor market factors over - 
a period of time Such quantification allows for a study of the labor 
force Secondly, the project facilitates study of "the developmental 
factors relating to the individuals. Finally, the study offers a rare oppor- 
tunity to compare the developmental pr causal effects of two or mote 
variables 

The NLS represents, in this section of ARRIVE, the longitudinal study ^ 
commonly funded by E&T sponsors. Actually, it fits several othfer cate- 
gories of research. It is. in a sense, a follow-up and cluster study 
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KAT2 STUDY 

Dr Katz analyzes the conceptual iss^ues relating to the co^ntributions 
of the employment service(s) to the continued employment of the ES 
client* He also explored the feasibility of estimating the influence of 
ES services on the earnings of the individual ES client. Finally, the 
study sought to determine if nonexpeVimenjal data sources could be 
used'to accomplish the first two ob*jectives. Twp data bases were used 
in the study The first was the 1972 Bureau of Labor Statistics Job 
' Finders Survey (JFS) and .second was the Employment Service Auto- 
mated Reporting System (ESARS) and Continuous Work-Benefit 
History (CWBH) files of the Pennsylvania Department of Labor. His 
findings r^evealed that ES clients take longer to get a job than do non- 
applicants The study had many other interesting findings and con- 
cluded that honexperimental evaluations were useful even though 
plagued with many limitations. This study represents an excellent 
example of evaluation studies that are intended to influence E&T 
policy development. » 

WORTMAN, MURRMAN, AND JONES STUDY 

As previously stated, this study by Max Wortman. et al., is currently 
in progress and is sponsored by the Governor's Employment and Train- 
rng Council of Virginia. The project is designed to investigate the 
extent to which educators and CETA prime sponsors have been able 
and willing to develop cooperative linkages. Emphasis will be placed 
' on the Identijication of exemplary linkages. 

The study will utilize data collected through (1) compilation of docu- 
ments, reports, aifid other CETA related publications, (2) questionnaires 
(mailed), and (3) oh-site visitations where interviews will be made 
relating to state and local levels of E&T involvement. The project staff 
will utilize both objective and subjective measures to evaluate the 
linkage factors including (1) participant coverage and involvement. 
(2) programmatic 'Costs. (3) local demands for skill Acquisition. (4) 
^coordination efforts; and (5) program innovation. 

The project plans to develop a policy model of CET A-Education 
linkages in local labor markets. The model should establish^direction 
for the following types of linkages (1) policy, (2) planning. (3) structural, 
(4) financial. (5) programmatic, ar1m"(6) operational. Thi^ study is 
tharacteristic of the .types of reflective synthesis (historical) and 
evaluation methodologies commonly used by E&T researchers to 
formulate a basis for policy model development. 

RUMBER6ER STUDY 

\r\ his study of ^jcollege graduates. C)n Runiberger'examined the eco- 
nomic fJosi^ion of college graduafes beiween 1969 and 1975. He 
measured the relative earnings of the subjects to determine if any 
detenoration in earnings had occurred. The study sought to measure 
the utilization 6f educational skills by the subjects to determine ^if 
the occupational position of the subjects worsened during the penod 
from 1969 to 1975' An overall goal of the study was to test the commonly 
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accepted views of Richard Freeman and Lester Thurow with a new 
base of data He utilized two major sources of data in his study The 
first source was the March. 1976. Current Population Survey (CPS) 
and the second was the 1970 1/1000 Public Use Sample of the US 
Bureau of Census 1972. The findings revealed that college graduates 
were not worse off financially at any time during the period studied 
Another fmdmg suggested that the college graduates were being in- 
creasingly over-educated for the jobs available to them upon gradua- 
tion. 

This type of study is often funded by E&T agencies It performs two 
functions. As a study that uses both follow-up and reflective synthesis 
methodology, it provides data that relates to the problems of college 
graduates. The study may also be one of several studies in a cluster 
This study i$ one of hundreds of thematic E&T studies that contribute 
to an overall understanding of the labor force. 

McKINLAY AND McKEEVER STUDY 

The last article in this section presents a review of sponsored research 
that was specifically targeted to the development of axareer informa- 
tion system for use by E&T programs. The studies that supported the 
developnoent of the CIS were specifically designed from a cluster 
concept'to Contribute to the (1) conception and development of the 
. early models. (2) refining the model. (3) testing the CIS. (4) implement- 
ing the CIS. and (5) finally, the evaluation and modification of the 
system Thus, the project was designed and funded by phases 

The project that supported the development of the CIS utilizes several 
research designs Survey.^experim*ental. evaluation, and follow-up 
studies were conducted^ Again, the cluster concept was used to link 
the individual project objectives to a primary goal, the develppment and 
implementation of the Career Information System The result was an 
important contribution to the programs operated through' the provi- 
sions of CETA. 

^* * 

SUMMARY * • 

Vocational education researchers are uniquely qualified to invest 
time apd energy in the research activities currently sponsored by E&T 
agencies at both fhe state and national le>^els The goals of E&T re- 
search'agencies are often common to those of vocational education 
The -unique opportunities offered by E&T research involverperit will 
serve to complement the research activities of vocational education 
with the result being the enhancement of vocational education pro- 
grams Proposal^ seeking support by E&T agencies should focus 
upon problems/and possible solutions Efforts should be made to 
describe In the proposal the benefits of such research to the DOL 
constituency. If the above concerns are adequately , addressed-, a 
competent vocational education researcher will find willingsupport 
and a continuing commitment to a comprehensive progranlj^ em- 
ployment and training research and development. 



Er|c • . " ^o ji 



366 



